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ABSTRACT 

This paper describes progress to date in the development ef a sys.tani for 
representing various fores of real-world kn owl Edge, The knowledge is 
Stored in the fern of a net nf simple parallel processing eletrehts, which 
allow certain types of deduction and S&t -intersection to be performed very 
quickly and easily. It is claimed that this approach offers definite 
advantages for recognition and many other data 'accessing tasks. 
Suggestions are included far the application Of this system as a tool in 
. ■ vision, natural -language processing, speech recognition, and other problem 



This re-port describes research done at the Artificial Intelligence 
Laboratory of the Massachusetts Institute of Technology. Support for the 
laboratory's artificial intelligence research is provided in part by the 
■ Advanced Research Projects Agency or the Department of uefense under Office 
pf Naval Research contract N 0001*1-75-006^ 3, 



TftBLE OF 'CONTENTS 
1 . About This Paper 
Z, Overview 



US. Relations and Francs 



'21. Roots 



1 
4 



3 + The Syubol- Happing Problem ' 

A L NvcLfts and Links * 

3. The IS-A Hierarchy 13 

6. Exclusive Bets and CUshfls IB 

7. Equivalent Ferns and Winston -Learning zz 
6, tugeitlon ahd Me H Every' Prflblei* ze 
g. In Search of the Hissing Llnfc 30 

10, The Three -Pronged QF-LinX. 3Z 

11, Accessing Formulas J ' 
IZ. Handles *nd IK-Llnks flP 

13. Exceptions Hi 

14. Inoediate Connection fl ° 

15. .Node Names and Speech Recognition ^ 

Ti 

16. The Context Hierarchy ^ 3 
!?■ 'Habitat and Recognition 57 



$Z 



19. Actions and Verbs 7i 

ZO. Concluding Remarks 7 * 



&3 



Bl&LlCfcRAPHY e4 



1, About This Paper 

In my thesis proposal [4], I described a plflfl for Imp 1 erne n t in Q the 
frame systems of flinsky [12] and applying these to various recognition 
tasks, biite last Spring (1974} this research took A surprising turn. On* 
of the many schemes I had tried for representing class- inclusion (IS-A1 
hierarchies --a' scheme using Qui llian-like nets of parallel processing 
eiemen t3--preved to have so many interesting- properties and applications 
that the study af this system has become tHo central focus of my research. 
Among Other things, this new rE presentational systef* eliminates the read 
Tor a network of deaens for silEfuesting recognition hypotheses, and it makes 
the checking of hypotheses much fasten 

After a month or two of placing with the new system {to convince 
myseir that It really was what ]t sinned to be), I decided that it was time 
to write up my preliminary results, For « variety of reasons, it has tafcen 
be almost A year to produce this write-up. The set of ideas that make up 
the .system Liecare very lime very quickly, and Simply would not stand Still 
long «ji r .iiiyl). to he written about cchflr-fint ly. Always there was one mare 
loose end. to tie up> one more example to work out, one pore idea, t& fit In. 
And. the very process, of writing about the systcn, on the few occasions when 
I actually got started, seemed to trigger major collapses- and 
reorganisations- All this has led to rapid progress In the research 
itself, but not to a paper, 

At long last, 1 have been able tn get a sort of snapshot of tha 
current stfttG of my research (ipwn on paper. The old u-robJem^ remain: there 
are many loose ends and inconsistencies , espec]iilly in the newer ideas 
presented toward the end, of the paper, and there has been a cnnis icier able 
evolution In my thinking even as this was heing written, I hope that All 
of this will not prcivB to he too confusing. A wore coherent presentation 
will be possible later, after things have had a chance to settle. 



Z. Overflow 

On its simplest level the new descriptive sy&ttm consists nf 1 
large set nf nodes that can be marked in various ways. These represent the 
objects^ Classes, and Other cnnr.-:iptii*l entities Chat the system knows 
about. Connecting these nodes, and- representing the relationships- between 
the node-concepts, are several types of iiflM- Ruling ov^f the whole 
network is the central processor {CPU}, a serial computer that broadcasts 
commands to the nodes and links via a common party-line DUS- Markers are 
passed and propagated from nod* to node along the link paths under tha 
strict control of the CPU. Since the markers can travel ajnng many 
branches in parallel, the system can mark very lsrge trees of nodes in only 
a. few steps. 

So far, this sounds like Q.Uilllnn h S network system. The difference 
is that by mating this type of network with a set of fairly rigid 
organizational principles--* hierarcHy of IS-A relations, for example--! 
have been able to establish much more precise control over the flow of 
markers through the net, QUilllan's system might typical l_v bv tasked to 
find all of the associations between LONG and HAN; rty system would 
typically be cvmn-Anrled to nark every man whose grandfather' 1 S mistress had a 
long nose. (This is not to say that Quill ian's system csuld not in 
principle follow complex paths or nine free-associate--the difference is 
mainly one of emphasis.) 

50 PWCh for the inspiration. The perspiration has been shed in the 
attempt to find exactly the right set Of organisational principles--the 
ri:f: r , wiiy r. M represent various sc-:s of 'iin^L'. i ii(|'.;--iiSii ng tnnse nodes and 
links., This task is not complete as yet, but enough of the systen has 
taken shape to suggest that the finished product will help to soIve (or 
circumvent) a number of long-standing AT problems. A brief summary of some 
of the system's, more interesting features: 

-Type or IS- A hierarchies are efficiently implemented.. Hembers of a class 
inherit all of the characteristic properties of that class and of its 
super -classes, merely by 'plugging in", Access- to these properties is fast 
and does not require pre -computation, redundant storage, or lengthy 
deduction at access time. This C 1 rcunwoitt 5 the problem that so plagued 
CharnUk (among many others) of how many ■obvious" inferences should be 
nade when a new fact is- received, and how n*jch should be left undone Until 
the need, arises. 

-The system can handle many orthogonal IS-A hierarche*, tangled together to 
any desired extent. 

-It is very easy in this system to find the intersection of two or mora 
classes. These classes can be explicit groupings represented in the lfi-A 
hierarchy, or they can be implicit groupings based upon sane common 
property of tne members- lhus r one can feed the system a list of 
properties observed in a sample, and have it return a list of all known 



objects or classes that exhibit such- properties. There is nore to 
recognition than this-- the list of properties twy be incomplete, imprecise , 
exceptional, or in orTor--bul this mechanism rail carry much of the load. 
In particular, it performs much more elegantly the task t had previously 
assigned to the SWant of "suggestion demons" : the discovery of hypotheses 
worthy of further consideration. 

-Ubon an inds vidua: iv nisianed (perhaps hypothetically) to a class, It 
inherits the descriptive properties of that class. Often seme features flf 
this description will. Vivid with features already present in the object, 
either directly observed or inherited froji soian preWOMS ass J gnment . The 
system cafl detect SUCh Clashes very quietly and easily, anil can then begin 
looking for excuses, or whatever. This ijuicfc clash -detect ton is obviously 
useful in testing recognition hypotheses. 

-The same clash-detection mechanism cart be used to enforce res t rj ctionj 
Upon the possible occupants of the various "slots" in a frame, a relation, 
or a v*rb. -Such a restriction can be ^ery penaral ("animate object"') or 
very specific ("left-handed Bulgarian tuba player"). Any attempt to make 
ap assignment that violates such a restriction is inwed lately detected by 
the system, (One can, of course,, force the assignment to occur anyway,) 
This mechanism would appear to have many uses, especially in linguistics, 

-Each piece of information in the system exists in some coite^i, and is 
only visible if the context is uctii?e. This allows the system to maintain 
many distinct WO rid -node Is, Information not in active contexts is 
completely out of the way and does net slow down the accessing machinery. 

-The contexts themselves form a tangled hierarchy with different levels -of 
generality, One can thus be operating in a very general context with A lot 
of information available or in a very specific context wjth much Jess 
potential for affbiguity and conFusion. The system focuses its attention by 
■oving up, down, and around on this hierarchy. This would appear to be a 
■uch smoother mechanism than, say, switch lug; between & few distinct Blnl- 
wprlcUr 

^Whllfl .1 do.n 1 t want to press this claim too strongly, this system or 
something similar would -appear to be ft plausible netaphor for hunan- 
intelligence , The elements seem rather neuron -1 ike, and because of the 
parallelism they could be rather slow (milliseconds). The system seems to 
mesh neatly with the requ i reoen ts of e. linguistic system. And, to me it 
least, it Jtelt right; the things that ought to be easy turn out to be 
easy. (I'll point out spme examples of this as I go along.} I hope in th* 
coming months to see What light the psychologists can sheo on this issue, 
and to gather together any .hard data that 1 can rind, pro or con. 

Is the special parallel hardware really necessary to reap these 
rewards' ] think SO, The essential step in all of these operations is the 
marking of all the nodes in 'snmfi tree (ir other, These trees are seldom 
more than ten gr so HnXS deep, but they are bushy, containing thousands or 



even nil lions flf nodes . The parallel schfrte. marts such trees id tine 
proportional to the itopth, while the time to mark serially grows as the 
total numhor of nodes, It is ny system's ability to mate liberal usn of 
trftt-Mrklltg that gives it any ^pocial proper! its it might have-. A 
recognition rto*i indeed havq 4 sequential component, but it is a sequence 
of parallfll tree-markings. Of course, we can simulate such « system on a 
serial machine fot testing purposes, ejp&elally if the total size ct thl 
knowledge base is kept reasonably small. 



3 r The Synbel -Hap ping Problem 

Suppose 1 tell you that a certain animal- -let ' s call him Clyde- -is 

an elephant. You accept this simple assertion and file it away with no 
apparent display of mental effort. And yet, as a result of this simple 
trans action, you suddenly appear to know a great deal about Clyde. If 1 say 
that Clyde climbs trues or plays the piano or lives In a teacup, yon will 
immedifltoly begin to doubt my credibility. Somehow, "elephant" is serving 
as flier 9 than a mere lahel here; it is, in seme S<?nse, a whole package of 
properties and relatiunships, and that package can be delivered by means of 
a single 1S-A statement. 

In principle, such behavior -can be achieved through the use oT sorte 
form of deduction, Each fast is a separate entity, and new facts are 
produced by knocking together two old ones. Thus, If we have "All 
elephants have wrinkles'* end "Clyde is an elephant", we have the right to 
deduce that Clyde has wrinkles. In one Tvrm or another, this has been the 
"standard ftl approach. 

But having the right to deduce some Tact Is not the sane as having 
the Job done- Much ingenuity -has been devoted to the search for fast 
deductive mechanisms, but the problem remains intractably combinatorial.. 
And when is all this nork to be dons* If we are to detect the obvious 
clashes between new facts and old. some deduction must he done at once upon 
■receiving new information. But we citirfrly r.annot afford to deduce till of 
the consequencss or the new fact- L to do so would take a very long tine and 
would hopelessly clog our memory with useless trivia. There seems to be no 
good way of deciding haw far this process should 00. And can we really 
believe that all of this frantic deduction goes on while the listener 
believes that he is Simply accepting a single, straightforward fact? The 
fastest machines bog down ^hen faced wlte a few hundred facts, Can 
' Billisecond- speed neurons succeed with millions of facts? 

[ could not helji feeling that sooething was missing here— that the 
discrete-fact deductive approach w»s never going to solve the elephant 
problem. Does this natter? Well, consider where Al has. been successful 
and wbere it has, so far, failed.. The triumphs have been In areas like 
calculus where the symbols being dealt with carry very Little semantic 
baggage Vhere there are rooms to traverse, or tables full of blocks., or 
missionaries and cannibals, these are abstracted and stylized: all but a 
very few properties are eliminated- Such a pitiful number oT facts can 
indeed be- handled an an individual basis. 

But what oT the real world, full Of shoes and ships and sealing 
wax, where elephants have not only size, shape, and color, hut also 
wrinkles, blood, flies, nM an insatiable lust for peanuts? The List is 
practically endless, and that is exactly the point. If the phrase "common 
sense™ means anything at all, it iiu.ic certainly include an awareness of 
these 'fringe" properties. In any given situation, one of these 
insiflnifieant details mey be of pivotal importance, I think that our 



critic*- -Dreyfus, Tor instance- -are right in claiming that M has made 
little real progress cut this front, 

]f r act-by-fact deduction is" inadequate, \s there perhaps snrifl way 
Of dealing with whole groups of raets at once? This possibility first 
occurred to ne whiJe ] wns playing with the nultiple data-bitse contests of 

i.::vJiV- :.!■:. wh ■ h allow whole Mis nf tarts ,■.: rn; to he iii:h!m v^Lble or 

invisible by a single doclarat ion . I also had in mind ftn irrmefe derived 
from the "pure" and "impure" code in a computer Systea; The elephant 
description should rot be copied *nd raodiFied fqr each elephant; rather, it 
should be kept "pure* and individual elephants should bo described by 
"plugging in" to this description and adding a small package of local 
assignments and modifications to the general model. This image was 
strongly reinforced and influenced by Husky's fraee theory . eventually, 
all of this led to the packet system described in ny thesis proposal. 

But packets were not tbe right Answer either, It is an well and 
good to matte the elephant description appear and disappear, but the real 
problem is to turn all of the. ELEPHANT properties into CLYDE properties. I 
call this the siFtlwi-mpping pj-oNem.- For a while, T thought that I could 
leave the owner of a property unspecified, but this led to terrible 
problems of anblQuity, especially Where the property was really a relation 
between two nore-or-lesj eguH entities, as In FATHER -OF. 1 had been 
playing with various parallel hardware schemes for implementing packets 
efficiently, and I decided to try something slnilar for syobol mapping. 
This Was meant to be an exploratory step, but the result was so successful 
in so many ways that l stayed with it. incidentally, I later realized 
that packet activation was just a special case of symbol Rflppitia and that 
it required the same sort of Jfiechanisras for success.) 









•\ . Nodes and Link) 

We will no* consider in some detail the nature Pf these nodes and 
links, and bow they can he Used to solve lh& symho 1 -(tmpp J n g problem. Th 14 
did not material];? all at oncer I am skipping over about a half-dozen 
intermediate steps ill the system 1 i evolution. 

The various concept; in the system- -for now we can limit these tn 
individual objects like CLVDE and grouping* like ELEPhWT--are represented 
by nudes. These are relatively simple hardware Units, Each one contains a 
permanently- ass lured unique serini number and a half-doeen or so 
independent flip- f] ojis called marker bits, I mentioned earlier that the 
nodes could he narked in various distinct ways; this is dnite by setting out 
or more of the marker pits in a given node unit. These bits are designated 
by letters j thus. He speak of a node as being "marked with an A-marker" If 
Iti A bit is on- 
Each of the nodes is connected via a common party-line bus to the 
CPU, from which it gets its orders. The CPU caft specify any node by serial 
number and can order that node to alter or report its narker status. More 
often, a command Hill ho broadcast to any and all nodes containing some 
particular marker or combination of markers. Sometimes the CPU will Just 
want to knew if any such nodes exist; sometimes It will want these nodes to 
Change their marker state in some way; sonetimes it will want the selected 
nodes to report their serial numbers over thn bus. If many nodes try to 
report at once, they are queued up in order of their serial nunhera [or 
perhaps -in order of their position along the bus) and they report in one- 
by -one. 

These nodes are analogous to Lisr atoms in several respects. The 
actual Bord "elephant" is not a part of the ELEPHANT node, but is attached 
to it as a property, (The details Of this will he discussed later,) 
Instead, the node we will call "ELEPHANT* represents the COflcept of 
elephant and is known to the systnu by its semant ically sterile serial 
number, A few nodes may have sone special meaning in the CPU (like MIL in 
LISP) or some direct association with the raw output symbols of the I/O 
system, but most derive their meaning from the way they are connected with 
other nodes, 

These connections are represented by hardware link units running 
between the nodes in question, for now, let us think of those lints as 
cominn in many different flavors, corresponding to the different possible 
relations in the system. Thus, to represent "Clyde is an elephant" We 
simply connect an is- A Link, from the CLYDE node to the ELEPHANT node. 
Similarly, we night have m 0*415 link from Aor.KEFEL.LEll to STANDARD -DIL, a 
FATHEP-0? link from AURAHAH to l5AAC h or a COLdR link Trom ELEPHANT to 
GRAV\ These links have a direction, in the itnse that a relation like OWNS 
at- FATHER-OF is not commutative, but markers can be sent across then in 
either direction. (We will later see a *zy of getting along with only a 
single, rnore zaKp lira ted kind of link.) 



These link units are considerably more than mrre labeled wires 
Each 13 a hardware dnic that is connected ta the Jtarty line bus, and each 
U able to carry nut simple commends received from the CPU. These hardware 
UtlitS are connected te the nodes that tltey are supposed tn he linking by 
dedicated private ljiui-actual *ires that are not shared with any other 
link unit. Over these private lines the link units can sense and alter the 
marker Status of the attached nodes. When I speak of a "link" I will 
Usually he referring to the hardware lint unit and to the attached private 
lln#5 As a single entity. 

The commands sent from the CPU tfr the Hi* units have two parts: 
first, a specification or which Units are to respond; then, a Statement of 
what th«* e selected links are to do. Ususatly, a whale set of Links will 
be selected at once, on the basis Q f their type and th* marker .status or 
the attached nodes, ft eomnand might, for instance, he addressed to all 13- 
A links whose Incoming node (the X in M X I3-A V") is marked with hit A and 
whose outgoing node £Y in the above example } is not so marked. The CPU can 
sense whether any links claim membership in this group. The comand 
follows: la this case, it might specif* that each Of the selected links 
shim )il mark bit A or its outgoing node. Beee-Use of the private line 
connections r all of the selected links can perform this operation 
simultaneously. The net effect is to propagate each of the A markers tn 
the system across any adjacent qHioUb K-A links, ill in a single machine 
cycle. 

■ . ■ : 
Now. if w nurt CLYDE with hit A, and we then repeat the above 
operation until nothing more happens, we v,m have pluced an A marker on 
every node that represents a class of whir.:, ri-^e is a member, either 
directly or by transitivity of IS-A. If, instead,' we nark rJAHHAL initially 
and nropapjate the markers across IS- A links in the opposil* direction wa 
will have marked -every node that represents a kind nV HAH MA!, and every 
individual MAMMAL. Regardless of the number or nodes marked in such an 
operation, .the timereq-uu-ed is proportional only to tin number or links 
forming the longest branch of the tree. It is ver* hard to think of a 
reasonable chain r,r is-^ relations lonoer than ten or fifteen link* — try 
it! What all this means is that, given this hardware, we can use tree- 
marking- as an operation with no more trepidation thap a LISP user would 
feel in using a CWJD or a $ETq. Even if th-e tree is, say, the tree of all 
Physical objects. Even if the elements of the system operate as slowly as 
say, neurons. T ' 

' 

And this, I claim, breaks the back of the synbol -map ping problem. 
When we tell the system that Clyde is an elephant, it Simply creates an 15- 
A link from CLVDE to ELEPHANT. Un the process, it Checks for clashes-- 
raore about this later.) ELEPHANT, of course, is linked to many more 
general categories: MAMMAL, ANIMAL. QUADRUPED, HEK6]vrjRE, PHYSICAL-OBJECT 
and so on. £aeh of these Classes has its own set of characteristic 
properties, represented by property links attached to their nodes, and all 
Of these properties are to be inherited by CLYDE > Now, if we ask the 
.system for, say, Clyde's color, it won't know which node to look at, but it 



rinesn't mutter* In a single sweep, it narks all the nodes superior to 
CLYHE; then, it asks any CQLOR-DF links attached to any or the marked nodes 
to mark (with a different bit) the associated color node; finally, it asks 
the marled color to report itselr to the CP"U . Thus, It becomes unimportant 
whether a property is attached directly to GLIDE, or Is really attached 
jonewherE far up a chain of [ft-A ]|nk$ r There is much to he added to this 
picture- -exceptions, for in stance- -but this is the key idea. 

The opposite marking process — from a class to its sub- da* -ins and 

members- -has its uses as well. Suppo.se we have an OMNS link froci KING' 
ftRTIUlft to F.KAURUR, his famous magic sword, -Suppose that we want to Know 
if any kimjs own vny weripo-ns. We simply mark with bit A every KING, mark 
with hit B every WEAPON, and look for an 0HNS link between these two sets. 
Out would pOD the AFTHllR/EJtCALIBUR Link, along with any others that the 
system might happen to know, To mark all weapon- owning kings we would nark 
all weapons (bit A), then all their owners (bit E] , and. finally all kings 
(bit C), Any node narked with both B and C is a winner, 

&efore we go on to the more complex issues that arise in trying to 
use these nodes and links properly, perftaps it would be worthwhile to 
briefly consider whether we can, tn fact, build a systen like this using 
existing technology. The problem, i believe H is not with the node and link, 
units thorns elves —these are indeed expensive, but not ridiculously so given 
LSI technology— but rather with the private lines connecting them. As the ■ 
system learns new things, it will need to create new connections and 
occasionally destroy oW ones (though some form of cancel'iatinn might 
substitute for HnX- destruction}, This link-alteration cart afford to be 
rather slow, since it corresposids to a Ion y- term memory alteration; there 
.are tricks, we can use to represent a iiwtted number of quick, temporary 
alterations until they are no longer needed or can he wired-in permanently. 

There would appear to be two possibilities: either we oust have 
sone device or process that c*n connect tor grow) a wire directly between a 
node and a liihk terminal, or we need some kind of crossbar switch. Tmagine 
a sat of wires --one froG, each node-- running north/south in a plane. AHove 
this is another plane, made of link-wires running east/west. Wherever two 
wires cross, a connection can be made or broken; this is called the cross 
point, it would, obviously be too expensive to put an actual switch at each 
such point, but perhaps there is a cheaper way of making and breaking 
contact at such points — So»fr sort of electrochemical goo that turns locally 
conductive when appropriately zapped ant) stays that way until it is somehow 
unmapped. It' would help somewhat to group nodes and links int^ richly 
connected neighborhoods, with relatively few Connections running to Other 
neighborhoods, hut this night be more trouble than it is worth. 

What I'm trying to say, then, is that It would be Tar too expensive 

to implement this system on a large scale with currently available 
hardware, but that the development of a much cheaper implementation, 
technology is Hot inconceivable. In the reeantime. the system 3S well 
enough defined to serve us as a precise metaphor, and it can. be simulated 



for testing pruposes, (Of cours?^ in tjie simulation, trfle-warking will 
again be prapnrtional to the n-jr-er of nodes in the tree, but wo- will tie 
able to tell hon long the hardware TOiild have taXen.) 






5. The IS-A, Hierarchy 

The backbone of the descriptive system- -the rijjid structure which 
keeps everything else from collapsing into a heap--ii the riEtwark of 1 S-A 
lints. These lints tie all oT the nodes in the system into ft single 
tangled hierarchy of groups, subgroups r and individual membErs. Vith 
perhaps A few exceptions (to be noted Inter) every node is connected by at 
l^ast one IS-ft link to some more general -category thnt includes it; every 
concept has an identity. Eventually, all of thEse u pward -mov ing IS-A 
chains con vu rye upon the syslom's most Berteral node, named THING, which 
includes everything (every -THING) else, 

Before proceeding let me mate explicit B convention that I have 
already used ence or twite, and will use a lot more in the remainder of 
this paper: IS-A lints will be spoken of as pointing upward- Tim flAllAL. 
node is (PJwve f-L.FPHAM and below ANIMAL. IhE more general categories are 
the superiors or a/tcssiori of the leSs general ones. TH1MG is at the tap 
of the tree i CLVDE and other individuals are at the bottom. Links 
represent ing nther properties run m>re~or-less sideways. This will Sflve ft 
lot of words in the long run.. 5uth *■■ magi 1 l* po^tble, of course. 
because the 1 5- A lint. 1 ; do not form loops, (ExcerLlvn; nt nay say A IS-A B 
and B IS-A A if we want to indicate that both nodes represent the some 
concept. This is useful in certain perverse cases.) 

Probably the most important aspect oT the 1 5 -A tree is the way 
properties are inherited, Consider a node like C0V P (One grows weary of 
elephants after a nftile-) Properties a.nd relations attached to the CQW 
node itsair. •■■•■ '<■■■ i"<; ■-■■''■■.* >!: • ■;,:, j ■■ .v.'-n- ft in tl* , , , : :-^1 \r?.t. arR nennt 
to apply to all cows (though particular individuals can cancel particular 
inherited properties). Properties hung from nodes itflaa COW apply only to 
some cows. In Figure 1, for instance., we see that all cows are wartfl- 
blooded and have udders (barring exceptions, that is], but that only JO-me 
cows are black-and-white, while others are brown, There are net, to the 
systen'-s knowledge, any purple gons, but this is not ruled out. If asked 
what color cows are, Che system would first mark, upward from COM, but would 
find no COLOU links there. It would then mark downward from C0M 4 Find 
several COLQft links, and report that cows in general have no particular 
color, but that some cows are brown and some black-and-white, 

It is important in choosing marking and accessing Strategies, 
always to respect the transitivity of the IS-A links. If COW IS-A ftAKftAL 
and ttmHAl IS-A AHIKAt. then Cflw I5-A AKIfWL, whether or not there is a 
lint explieitljf saying so, This effect is achieved if we are careful 
always to let upward or downward marker sweeps run to completion; we should 
be very suspicious of any accessing strategy that sends markers some 
particular nuabtr of steps up or down the tree, 

A corollary of this transitivity is that we are always free to 
split an IS-A lint, for instance to add ttie node UNGULATE between COW and 
MAtiftAL, Once we have added CTV I5-A UNGULATE and UNGULATE IS-A MAMMAL, the 
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original I5-A link from COW to HAMM, Becomes rodendant- The system can 
reclaim this link or leave it m place, whichever is easier. As you can 
sea h it nakos sense to talk abnet are node being above pr below another* or 
between twp others, or heiog off on sorae unrelated branch of the I S-A tree, 
but it makes wery little sense to talk about tUstoncei up and down the 
tree t slnCo these can bo measured along various paths and changed at will. 

The l$-i\ network is a tangled hierarchy. By that I mean simply 
that a given node na>' have more than one imnedlflte superior, but this 
simple fact ran ha^i jgne interesting aloha] effects. In the raore ["ftffliliflr 
ntui-tcnu' 1 '" hierarchy, a node may have many IS- A HhXs Terming out below 
It, but only one lint to a superior, This cor venti.on leads to downward- 
branching trees like the one in Figere 2a, in which no two branches ever 
recombioe ooce they have separated", figure Zfe shows the tangled hierarchy, 
in which the branches do tangle back together at various lower nodes. 

The difference Is mora dramatic if wo look at the tree Train tbo 
point of view of some typical node-^call it X--in the middle- of the tree 
(Figure :*) . Io either case, the descendants of X fao out into a profusion 
of subclasses and nnr.hers, but looking upward from X it is a different 
Story. In the untangled hierarchy, X has only a single -strand of 
superiors, while with tangles the tree of tf's superiors can fan out to 
considerable: TJimensions before it starts converging hack towards tho THING 
node. X. IS thus in a position to inherit a very large and diverse sat of 
properties. Without some sort of parallel accessing system this could he 
ao enbnrrassment of riches, but with the nodes and links described earlier, 
a large tree can he marked and accessed as easily as a single Strand of 
nodes 

It Bight seem that there Is some danger of ruoaway markers finding 
their way through the tangles and marfciog everything. We can avoid this by 
taking care to murk Qflly Upward or only downward from a node, but never 
both in a single sweep. (Renenber that there are no significant loops of 
I5-A relations in the system,) If, for some reason, we should want to nark 
hath the ancestors and desceodants of a oode. we Should do this with two 
separate sweeps, and then convert the markings of one set to natch the 
other. 
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G. Exclusive Sets and Clashes 

The need Tor tangles in the 15- A hierarchy arises lYon the fact 

that most group nodes Gin be divided into sub-groups in many different 
ways, according to nore-or-less orthogonal sets of features. The PERSON 
node, for example t can be divided an the bam of age, sex p occupation, 
raco, height, and SO on. Vhile we would not normally have occasion to 
tangle together the results of any single spllt—ttALE and FEMALE, ror 
example--we nay very well want to recombine the results of different 
splits, as when we reconhine NALE and CHILD to pet BQi - \ '. LJ'-ire 4 Shews a 
part Of the tree \Y\*\ hangs oelnH PERSON", Thv existence of a rccnrabined 
node lite B0 V not only gives us a way of- including nil individual in both uF 
the superior categories with a single lS-A lint; It also gives us a place . 
tq hanfl any properties that are characteristic oi Ue r-a.^M.na t1i oil of HALE 
and CHILD, 

The arts in figure 4 indicate various exclusive sets among the 
sub groups of PERSON, An Individual ur group may have an .IS-A link tu on* 
member cT eircfl of these groups, but only one. Any attempt tu In- 
directly or indirectly- -to a .second member of an exclusive set should be 
detected by the system as- one fan* of ctflifr- 

The actual clash may occur far up' the tree from the offending node. 
To tafce a rather far-fetched eMttple, let us try to imagine a marsupial 
mushroom. These two classes da not directly clash with each other, but if 
we trace the IS-A chains, upward t we find ourselves marking both FLANT and 
AUlflAL, which are part or an exclusive set under LIVING -THINGS. Wc might 
be able to mate sense of this by treating one class or the other as a 
metaphor ar an a 1 o ay- - p erha p s we have a fungus that protects its spores In a 
pouch--but we are not free to accept this description literally, as we 
would if the object were, say h a marsupial herbivore (no clash). 

Ue would, Of course, like to have same quicfc way of detecting these 
clashes. Even if this only catches gross absurdities, that is it least a 
step toward some sort of common s.nr.5*. The trick; is to create two distinct 
flavors of nodes. «c(u*iue and a da- exclusive (or regular) nodes. These 
types can either be inherently different or pernanently parted with an 
exclusion bit or labeled with an appropriate lint, whichever is easiest In 
a given implementation. A node Hue PERSON, which encompasses several 
exclusive sett, becomes a regular node with several exclusive nodes hung 
below it (figure 5). 

A clash is detected whenever marking upward from a. single node 
causes markers to pass through an exclusive node from two different 
incoming IS -A lints. Suppose we want to add a new tS-A lint above a node X 
that already has some connection to one or more higher nodes. First t we 
mark with bit A all of the inferiors af X according to the ofrf llnfci. 
Then, we send bit [[ pr Of aga t in g up the rr*B link in such a way that when a 
B-marker enters an A-marked node, it deposits a B but goes no farther. We 
then ask any exclusive nodes with both A and B marks to report in. If 
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there are any, these are the clashes, 

Any specific suggestions that tne systeti night have for dealing 
with a particular Clash can be hung from the exclusive nods representing 
the clash, but usually we will just resort to general methods Tor 
reconciliation, Depending or the evidence we have far asserting -nach cr 
the clashing links h we night singly reject one or treat it a.( a metaphor. 
Sometime we cfln turn off the iilarm and ignore tlie clash, but this usually 
just leads to more clashes as we try to reconcile tne properties of the 
incompatible classes. (Blend or sap? Cellulose cell walls or not?) 
Sometimes, as with the englena gr the sex of an earthworm, we wilt have to 
create a new set tQ represent the individual in question and add this to 
the set of possibilities under the exclusive node; this most often occurs 
when there is a twilight zone between the categories or sons sort of hybrid 
of them, but if can represent a ceupmely new possibility. 

The mechanism so far described catches only clashes between 
$xplic-\t categories to which an object is assigned; clashes between the 
properties of an object cao he mare difficult. IT we say that II person has 
a long nose, and later assign him to a class that implies the possession of 
a short nose, we flight not notice the discrepancy which would be obvious if" 
long-noswd people nnd short-posed people were considered as distinct 
classes. Ve can't flood narters out to all of the parts and properties of 
a description and looJt for clashes, Since the loflfl of "long nose" would 
clash liipropBrly with the short of ■ short f inner" , or whatever. 

■ 

1 have not yet really attacked this problem, since It depends on 
certain details or the basic lioX format that have not yet been worked out. 
Fnr now, just let me say that clashes between an object's superior classes 
are trivial to find: clashes between global properties of an object 
{ herbivorous -carnivorous, large-small) appear to he deter. ":ahln hy a siogle 
swggp us well; clashes between, the properties 0/ purls would appear to take 
a separate sweep for each part. 1 don't thiol this is too inconsistent 
with human capabilities. Que final note: amy particularly important part- 
properties can become whole -proper ties h as when a person with large itHiselCi 
becomes a auscular person or a person with yellow hair becomes a bio ode. 
We will see how such transformations occur id a later section . 

The exclusive nodes give us a way of indicating what an object is 
jiot. If we are told that Clyde is not a naronal, we simply create atl 
exclusive set containing CU'UE and 11 Anna!., (oee Figure e.) Any subsequent 
attempt to coonect CLlrDE to MAMMAL, or to some sub -JUMBAL such as ELEPHANT, 
sounds the alar*. 

Andee Rubin [15] has suggested, in a similar context, the use of 

complete CKcIusiire sets, and Rick. Grossman [5J has built an entire 
descriptive system using such sets. These are just like regular exclusive 
sets, except that it is mandatory for an individual to fit into exactly one 
of the SUb-ClossaS in the set. This convention comes into play when we 
have ruled out all but one of the possibilities in the set: if I tell you 



that CLVDt is a vertebrate, but that he is not a fish, reptile, bird, or 
anpli 1 b i am , you can be rrnwwlrtjf sure that he is. a mammal. 

TCie problem,, as you can see, is that there very f6*i Classes of 
anything (outside of mathematics} that can be divided so cleanly that we 
are sure that we hams listed tit thfl possibilities, £ven IP so crystalline 
a dichotomy as sex we find sone isolated cases of hermaphroditism, XXV 
chromosome sets, and SO Oh. But "reasonably sure" Is usually good enough, 
and the process of elimination does sees to play a part in uur reasoning > 
especially where the allegedly complete exclusive set has only two or throe 
nerkuers- Sherlock Holmes, for one, used this sort of reasoning Ullltt 
often, and with excel lent results. 

It is a simplu enough matter to create a third type of node to 
represent these complete sets and to treat them as exclusive nodCJ for 
Clashing purposes. What \ have not yet round—and do not really expect to 
find—is a fast parallel way of detecting when an object has closed off all 
lint one of the possibilities of some complete set somewhere, SO that we can 
rush in and plug the object into the remaining possibility- This lack dots 
not worry mu too much; it seens to me that when hunans reason by 
olimmation, they prucefld laboriously, case-bycase, sometlbies making a 
lijt or counting on their fingers , In view of this, it would be surprising 
if the machi.nO were too good at such reasoning. We will -iee a bit more 
about this later, when we consider how the ma chine digests hew in format ion. 
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7, Equivalent Forms and W in stpn -Learning 

BeXare r go on tg introduce more machinery, I would like to clear 
i: P a. few rmaining points about the is-A hierarchy, and especially about 

bo« it grows and changes as new nodes and properties are added. For now 1 
will continue the practice, introduced earlier, of representing each 
property or relation- -COLOR, QWWS. Fftl NlK-OF-by US own type &f link, In 
a later Section we will see what these lints racllg look Ltfci, 

The first point to consider is that the transitivity of the IS-A 
relations makes it possible to represent certain relationships In a variety 
of ways, in Figure 7, we see that when a number -of nodes claim membership 
in some Set or superior groups, we can create 4 new class representing the 
Intersection of these superior groups and simply link the individual nodes 
to this. (The picture seems to say it better than the words.) 

Such transformations are not mandatory. All of the nodes in the 
left-hand diagram art hooked up to the proper superiors, and the System can 
get along this way in di finitely. Hut, especially when many individuals 
belong to a set witp rtany superiors in coamou, mafcino the transfoamation 
can save a large number of lints at the Cost of only ,-, single new node. 
Thus. while there is no particular urgency about it, the system can benefit 
from spending soma of its spare time looking for situations that can he 
profitably transformed in this way. The exact threshold of profitability 
in such cases depends upon the details :>T the implementation: the relative 
cost of nodes and links, whether old links can be recycled, the cost of new 
connections, and so on. 

Figure B shows a similar equivalency bused on properties rather 
than group membership. Where a number or individuals have some common 
property or group of properties, it is possible to make such properties 
characteristic. of a group, individuals, instead Of having to claim each of 
these properties directly, Jinply jpin the group by using an IS-A link, I 
will refer to this process—creating a gruUp-node and moving an appropriate 
set of properties from lower nodes Up to the group— by the term 
"generalization" and to the new node as a -generalization node". 

These selr-reorgani^ation processes, I believe, are responsible for 
the creation or the vast majority of the network's »td- Level nndes. A node 
like ELEPHANT is created as seen as someone has seen two or three 
individual elephants, to Serve as a place' to attach the very large number 
of properties that these individuals share. The simplest way to establish 
such a node is to cosimandeer the nede that represents the first or most 
typical meeker of the group to he the ne* group node, leaving its 
properties intact, ami creating a new subnrrtieiate node for the individual. 
Properties which, as more elephants are added, are found to be 
idiosyncratic rather than general are passed back down the tree tp the ne*f 
individual node. 

These ^aneraliaation classes are more than a Here device for saving 
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a [>w linksL combined with a suitable recognition strategy, they play an 
enornciui role in organ iziflg our perceptions. Consider how well the human 
speeds would have farad tr the ferocity of each Individual anima) had to 
ftt evaluated Independently, By the tliw some particular saber-toothed 
tiger has taken a bite of you. It is probably too late, It is a far batter 
Strategy to assign a new individual to iome group on the hasls of the 
readily-nhser^able information and t D assume that the rest oT the group's 
properties bold as well, ev'Jl! though tliese properties have not bSen 
observed directly. ]r any uf these assumed properties have been explicitly 
contra dieted by o-b se rva t i on p of course, the system must either change the 
identification or make explicit nut* of the exceptional properties, 

Sd we sea that by properly creating and using these generalization 
nodes, we can make A Tew observations do the work of many, in much the same 
way that we g „t CLVDE is-ft ELEPHANT te do the Worfc of nany Statements. The 
success of this approach depends upon the domain. Of course. In domains 
where the properties *re rather obvious anfl rorm coherent and widely 
separated groupings—animals Tor example--lt will be very successful In 
domains where tin properties are themselves hard to recognUe and where th* 
groups blur together and contain many exceptions, things win be much mora 
difficult. So while everyone agrees that ELEPHANT is a valid and useful 
class, there it mich less agreement about SCHIZOMRIMC or LfBLRAL {the 
philosophy, net the party), still, r am convinced that most of the 
catftgories needed for common sense reasoning are of the coherent, ELEPHAJJT 
type. Ovorzea lous use or gene rail Eat ion and an unwillingness to recount it 
Exceptions are dangerous, as hell: these Ure the sources of bigotry and 
racisa r along with many c-ttier fnr«s of too-rigid behavior. The system must 
try to find the he&t balance. 

Buv*,i- rt . 5 L^^ CDnCe|)t ELEP «^T is not some innate ideal category (though 
PHYSICAL -CBJELT n«y be); nor is it some precise mathematical predicate 
[ able to mite successfully with the Prototype Standard Elephant, kept in a 
vault in France*), though progress lh genetics may reduce 1t to that; 
ELEPHANT Is merely a shorthand for a bunch of properties that seen to occur 
together often enough for the shorthand to be useful* 

This way of looking at concept-nodes is an extension of (and is 
directly descended fron) Winston's description-learning system (23]* 1 
have emphasize the process by which generalization nodes are created in 
the first place, as the system itself searches out parts Of the net that 
can be profitably reorganized. Winston studied the process by which a 
useful generalization can be passed from a teacher to a learner, once it 
twists somewhere in the culture. Instead oF having t& search blindly for 
places te put generalization nodes, the learner is told, for instance that 
anrS ra V iffe, * 0nC strucUjn?E are all to be considered member* of the class 
ARCFL Ey showing the learner a Carefully chosen sequence or members and 
non-pembers of the class, the teacher is able to control with great 
precision which individual properties will be moved up to the ne* general 
node. 



It has been observed many times that the lanouaoe itself carrier a. 
substantial load of Winston- instruction in its collection of corn's. Not 
every node has a nanf, but every name has a nuclei. By observing what 
objects the name is applied to, tUc loamer can gradually ascertain the 
boundaries of the Intended class, and it is then usually a simple matter to 
deduce which properties should be roved jjk Random conversation can thus 
serve Hi a training sentence, though not a very efficient one, lore 
difficult concept! are better cenveyei hy ™re efficient means: explicit 
definitions, as when we state that a mamnal Is a warm-blooded vertebrate 
with hair and so on, This can be converted nore or less directly to A 
piece of network, 



In any event, there seems to be reason to hope that if we can find 
the right set of self-reorganization procedures, along the lines discussed 
above, we should be able to get the. system to do anst of the work in 
creating its o*n Knowledge net. finch of the rest can perhaps be taught 
instead of programed, though there will, be some nioimun of "innate' 
structure upon which the rest is built. This is an old drcan, of course, 
but it Sefcns more plausible in thft context of this type oT system. I have 
not even begun to work out the details of the reorganiiation strategy. 



B. Digestion ohd the "Every" Problem 

One aore lo<?ie Odd to tie beTore we go an to bigger things: As the 
logicians in the audience have no doubt already noticed, the system 
described so far has no good way af representing S-UCtl Statements as "All 
purple mushrooms are poisonous. " We can state that oil mushronns are 
poisonous hy simply hanging a FDISOIKiUS property on or above the ^USHTttWH 
node. We can state Chut purple poisonous mushroom!; exist, hy cr gating a 
node below riUHHkoyrt and lumping FURPL& anu POISONOUS [Yum this. (It nay 
also be necessary Co somehow declare this set non-empty.) But the fact 
that this class exists does not near that we are required or even allowed 
to move every purple mushroom do™ into it„ any more than we are allowed to 
move every gray anir.nl down jiito ELEPHANT, ] call this situation the 
"every' uroblen. The solution is not too difficult , We lahel certain 
nodes as being mQMtotnry and divide the properties of these nodes into two 
classes: CJiCfltitfl and cicidnLcl properties, (l» : e Hill see later a 
variety of ways of attaching these labels) The PURPLE- IHJSHRWrl class is a 
mandatary subclass of MUSHROOM; it has PURPLE as an essential property and! 
POISONOUS AS an Incidental. (Sou Figure 9.) 

JJow, whenever we add a new nef*er to MUSHROOM or add a new property 
to some Dushrooo, we check the various mandatory subclasses of MUSHROOM 
(and of its superiors) to see whether the individual fits into any of them. 
To fit, it must explicitly satisfy all of the essential properties of the 
mandatory node: in our example, tire individual nust be PLFRPLE, Note that 
merely railing to clash with PURPLE is not good enough h but being some kind 
■ of purple is. Once we have found a nandatory subclass which fits an item, 
we rairjt move that iten down into that subclass. The individual then 
inherits the incidental properties of its nex class-- in this case 
POISONOUS, 

Since the properties of a class can be inherited as well as being 
attached directly. Me nust also allow the mandatory nodes to claim 
essential and incidental class membership. Figure 10 illustrates this. If 
any individual claims nembership in all of the essential superior classes 
of a mandatary node-- in this case, if it Is both a MUSHROOM and a PURPLE - 
QEJECT--then we move it down and let it enjoy membership in the incidental 
(POISONOUS- PLANT) classes as well. The two systems can, of course be 
combined: to fit into a mandatory class an individual must show all oT the 
essential properties and belong to all nf the essential super-clashes,. 

This scanning process, initiated by the addition of new information 
(links) to the system, is an example of what 1 call iNjesneir, The clesh- 
Cheching process ahd the search for complete exclusive sets with only ore 
regaining possibility are also digestive processes, These digestive 
processes fill the sane ecological niche .as the IF-ADDEti demons of other 
systems, but they are more limited: in power; there are only a few types df 
digestive processes, and only a single way of representing each. To me, 
this seems like an advantageous limitation. Once in a great while the 
systen may need to change or augment its central program for digestion 
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control to accomodate some new process, but it is not continually having to 
write now demon programs or to arbitrate inter -demon dispute*. T supple, 
n the absence of sufficient hard expense, tt is 4 matter of ta*te, but 
I rind the manipulation gf explicit data structures to he a much leis 
fearsome process than the automated production of debugged programs. 

Unfortunately, the digestive process is both tedious and open- 
ended. Tedious, because the parallel tree-marklng process cannot carry 
much of the load. Some nhases of the Operation- -the marking of all 
possibly. relevant mandatory nodes, for instance-can be done in parallel 
but ultimately the system must sift through possibilities en an individual 
basis. (1 think so, anyway.) Open - ended, because the essential properties 
may themselves have to be deduced from other things, mf vuasi-UfiJtitum 
The non-membership of an iten in some class under a complete exclusive node 
■ay alio require SOme effort to establish. 

CLflarly h what the system must do is to perform as ttuch digestion a* 
it has time for, and then proceed to Other things. This nenns that 3. one 
potentially-deducible con sequences of the new link may go undeduced, hut 
completeness is not the highest mental virtues-humans ieem to get along 
well enough without it. When the intern is hurried it will overlook a 
great many consequences; when it can afford to be more contemplative it 
Mill overlook much less, [f a iiflrticularly promising digestion must be 
abandoned, the system can mark it jwnehow and come back later, when It ha* 
some spare time. And, D f cour.ie, the system can cone back on the ha?, is of 
need- -looking for the necessary essential properties, when it wants to 
establish some incidental property; for instance, or investigating some 
particular area that is suddenly of interest „ 

All of this digestion business is just a forn of logical deduction, 
and net a very efficient form at that, r have taken sane pains to include 
it because it does seem to play a role in hunan thought, and because 
Quillian's networks have so often been criticized as being unable to handle 
quantifier* and Che like. As we have seen, such things can be integrated 
into the present sys ten without undue strain. 

But the application of such precise logical statements {All purple 
(■ushrocviu?) seen to me to belong to the domain gf abstract sanvtntial 
Winking, rather than to the kind Of intuitive, seemingly instantaneous 
thought that characterizes, say. the recognition of an elephant, This is 
why 1 am not particularly bothered .^-o-jt my inability to find a fast 
parallel way of carrying out the digest jve process— why. in fact 1 have 
not really looaed very hard for such fi method. J just don't believe that 
speed in tills area is necessary for human-level intelligence. 

Perhaps all of this will be Clearer U viewed from a slightly 
different angle. What we really have are two different, though conpatible, 
rami lies of intermediate nodes created by two distinct processes, £nn@ are 
created by generalization fro* below, as we saw in the previous Section 
IFiese nodes reflect the empirical observation that pertain sets of 



properties appear together in many individuals. F.LF.PHAKT is such a. node. 
Individuals are placed ill the ELEPHANT group not on the basis of any one 
property, but betau.se they fit in that group better than they fit anywhere, 
also, and because they do not clash with the ELEPHANT requirenents. Any 
set oT properties Mill do. as long as they are surricient to rule out the 
Other conpeting classes ; the rait of Che ELEPHANT properties are then 
inherited. 

This process of noting a sample down into a class on the basis of 
whatever properties are readily available Is what I have been calling 
recognition and, A3 we will see. It can be quite fast. The price paid for 
this speed is some residual uncertainty that we art- really in the riflht 
place. Mb don't really have a rfecijive test For ELEPHANT, but we can trade 
time for greater certainty! as we gather nore and rtore properties that fit 
the ELEPHANT description, it becomes i ncrea 5 ing ly unlikely that we are 
dealing with some other animal, 

ThB other nodes, the mandatory ones, are created not by grouping 
together lowly individuals, but by splitting apart higher nodes on the 
basis oT some particular property. Once miSFTROTH has been divided into 
subgroups Oh the basis of color, we can loot for incidental properties 
characteristic of the oembers of these gmups--<H [ the ncmbors, This 
process can more legitimately ^ive rise to sweeping generalities than can 
upward- grouping . The were fact Chat we have found a lot of poisonous 
purple mu*hrvum.s does not give us the right to say that all purple 
mushrooms are poisonous r h»lt U we have caraFuLly divided all known 
IftUS-h co om s hy color and have found all the purple ones to he p o 1 fcvn-uu S , we 
can at least state our rule for Apowh mushrooras. If we are prepared to 
beille-ve that known mushrooms are all that we ■Kill encounter, we have merely 
to set up a mec«:-jn L an For applying this rule, mechanically and inexorably. 

The real difference, then. Is in how the two systems handle the 
inevitable uncertainty that arises when we try to deduce a property not 
directly observed, merely because the world has always been consistent in 
the past. The upward generalisation raerely summarizes past experiences; 
the act of faith occurs when the recognition program assigns a new member 
to this class on the OflSlS of only a few of the necessary properties, 
assuming that the rest will oe present, la the downward Splitting process, 
however h .the risk 15 taken in formulating the rule itself--in attempting to 
derive a universal truth from some collection of observations. If we 
choose to accept this rule, we can then proceed with absolute certainty by 
logical deduction (or digestion). Ironically, this certainty makes the 
recognition task harder, not easier, The deductive systen is brittle T and 
since the slightest error can lead to vast absurdities, the digestion must 
proceed very carefully. The gen era ligation -recognition process is much 
more forgiving and, I believe, plays the central role in the intuitive- 
level thought that so far has eluded us. 



0. In Search Of the Missing Link 

. 5o much Tor amateur episte™ology-"it 's tine to gel back to nuts and 
bolts. Specifically, It's Urn: tc consider What we really want to use Ln 
place of our oi hoc wenngerie of link species. CJeflrly, we Must find a way 
of representing all possible Inter-uode relations with a single type of 
link, (or at most a very snail number of varieties). Occam's razor aside, 
this is a matter of practical necessity: the number of relations in use is 
huye and over-growing , and the inventory problem would be enorHOUS. 

This inventory problen is solved easily enough by the use of a 
single h standard type of hardware link with a register into which is 
written the name of the relation it reiiresents--FATMEK.-OF or whatever. 
Alternatively, wo could make our link units with three distinct private,- 
line terminals: two running to the two nodes being linked, as before, and. 
the third running off to a nude representing the relation. This latter 
form is preferable K since the relation is Itself represented by a node and 
can thus take its proper plate in the IS-A tree, acquire properties, and so 
on. We might, for instance, want to note that FATKER-OF is a kind of 
KELATIVE-OF. 

i 

This is all Tight as Far as it goes r hut it is ncit enough- A 
relation is more than just a magic word whose invocation tales us from one 
node to another--a relation must also have a CTCoflijij. By its very 
existence,, a. statement like "X is the father of VH tells us sometMnfl about 
X; that he Is an adult male animal. To say that KARY is the father of V 
would generate a clash, since we know that tlie name Mary i£ typically- 
reserved for females. We also know a bit about ¥; that he or she is 
considerably younger than X and is of the SJlme species. 

So each relation supplies a set of ro2e5 or tints into which the 
ltu-.S being related must fit, and to which they become connected by [£-A 
links (perhaps implicit Ones) when the relation is stated. These roles nay 
be very specific classes or very general ones. The WII6HT-OF relation, for 
instance, has one rote that can only be filled by a certain llnd of unit-- 
some number of grams, pounds, or tons--an<t another role that can be filled 
by any physical object. The latter Category is very large, but not 
universal: ideas will clash, as will substances. Iron* you see, dines not 
hdve wei<iht--lt has density' a pt*ce of iron li an object and will not 
clash in this role. 

The meaning of a relationship involves, riore, even, than the 
imposition of roles upon the relatees. If We use FATHER-OF in a strictly 
human context, we find that it conjures up a whole constellation of other 
relations, roles, and even stereotyped actions. We find that both K and Y 
are parts of a structure called a Family, which has slots for an adult 
female (K's spoiise, V's mother) and for numerous other people, all 
connected by a dense network of relations. We find, in nost cultures, that 
X is supposed to support Y while Y Is young, and that Y is supposed to act 
respectfully toward JL And SO on. 



The problem, th-c-n , 13 to .find a representation for links that give* 
lis access to (l£ much of this meaning as pussiDIe ifithtitlt doing 4 lot of 
deduction. Just as we wanted to simply plug into the ELcPKfrNT node and 
Inherit all or its properties, wa no* *,mt to simply hoot up X FATHER -OF Y 
and get all the rest lor free. £ This is not exactly something Tor 
nothing-- the hardware, you will recall, is the rather costly secret 
ingredient.) Of course, we can not let our zeal for efficiency lead us 
into rep res on tat ions in which certain things cannot be expressed at all* 
though we vdll continue to concentrate the system's efficiency where tt 
seems to be most needed. 



The battle is far fron over. The mechahisias presented from here on 
are simply ny current best guesses, subject to Ch«h!jii- Still, J don't 
think they are too far from the ultimate goal, In spirit if not in detail. 



10, The Three-Pronged OF- Lint 

Quite early in the system's development I hit upon a lint 
configuration that seemed to. do fairly well all of the tasks I had in mind 
for it. 1 call this structure the 3-prona/ed QF-link. With a fa* 
«nbe 1 1 i s hnen t s , this slnflle link type has been used in almost all of ny 
ttlillkJito about descriptions Find their uses. Other fornats have proven to 
be preferable far particular purposes. buL none has shown a comparable 
generality. An added beauty of the Of -Lint is that it is practically a 
one-to-one mapping of the >*ny property relations are normally expressed In 
English. The i-proncjed OF- link will be described in this section and will 
be used in most of the examples in subsequent sections. 

Lately, however. I have had some second thoughts about the Qf-llnk, 
As I have turned my attention" from static descriptions of objects, parts, 
and properties to (tore complex systems of frames and varying' contexts t the 
OF-link has became increasingly awkward tg use. It is Still iu/eduata, but 
I have begun to feel that a. link based nrara on the context-sitbcontext 
relationship— "in" rather than "of"-- would be preferable. Perhaps, too, I 
h.r..-.! - - . - ■— i -- -■m fri-.il.if.-.] Ln seeking a mumIi- uruverstil Ink -tyre, rather 
than a. re* types. I will return to some of these possibilities later on, 
but for now the OF-link will serve us. [ Cave mentioned these doubts 
merely to indicate how far all of this Is from being chiseled in granite. 

Figure 11a shows the basic OF-link. The relation it represents Is 
usually stated "as # A is the B of C or, if A Is not unique in playing this 
role, as "A is a B of C*, This format can be used for properties, 
relations, and for subdesGriptiens or parts. The rest of Figure 11 
illustrates this; "QREEN is the CQ10R of (every) FROG"; "ABRAHArt is the 
FATHER Of ISAAC- 1 "a TRUNK is the NOSE of ah ELEPHANT". 

Wow. an important point; focfl of these 3-prpngcd links carries .ah. 
implicit I5-A link from A ta E. Thus (fFfctN 15-A COLOR, ABRAHAN IS- A 
FATHER, and a TRUNK lH-k NOSE. Properties and group membership are passed 
ctown these links just as they Mould ne oyer a ncrnal IS-A link. In fact, 
we can. now eliminate the I5-A link as a separate entity: it is nerely a 3- 
pronged -OF-link with the OF-prong left unused. So the OF-link both states 
a property relation and locks the planer dorfe A into the role B. if the 
playar clashes with the requirements of the role, this will be detected by 
the mechanism described earlier; thus, Our suspicion of the statement *flAR,Y 
IS the FATHER of CLYDE", 

The variability ef the little words—a, an, the, every--in the *A 

is I.':; U :f C" f-— .Mf. m-hiiii. U- bo the- sr-rr- p-^npln. These *vttli do not 
reflect any difference in the link Itself, but are rather signals to thi 
listener about the context and the nature of the things being lilihed. 
-The" signals uniqueness, while H a/aTi" does not: thus, we have m the father 
of Isaac" but,** terminal of resistor Rl. n individuals—Isaac, for 
example--get no article at all. (We hill sen inter How such individual 
nodes are labeled.) ' To speak, of the color of a froj is amh iguou s : we mean 
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cuerif frog, and to avoid confusion we h-n d better say that, lest the 
listener assure we mean s©*» part i cu 1 a r p trot unspecified^ frogj, Despite 
the woMlng, the liiifci in Figure 1) are all the same and are used In the 
same way. 

ThebQ lints allow us to create Vertical layers of description, as 
shown iti Figure \Z r a fragrant of the description af an electronic network, 
A TERflENAL is a. PART of an ELECTRONIC COM'OkR^F ; R. TRANSISTOR is a kind of 
ELECTION lC-COJlPONtNT and an EMITTER Is Cine of its TERMINALS; T] is a 
particular TRANSISTOR find El is its EHiTTEfi. Tl inherits the properties of 
the COMPONENT and TRANSISTOR cJflt&es; El inherits the properties oT 
TERMINAL and EHITTEA, If? see here r for instance, that Tl is mada of 
COPPER, because nil terminals are. 

tn the last section I suggested that a relation inposes a role on 

J>0 th Of the related nones,. 'Ihj have seen how the OF- link casts the player 

node into a role, but what about the node ftt the end of the OF- prong r which 
t call the owner ? 

There are two answers to this. First, note that if I say to you 

■El is thfi EhtTTER ^ T] , " you know at once that T] Is a TRANSISTOR. 
Looking at the EMITTER node, we can See that it is defined as a part--a 
TERJHNAL"Of a transistor, and of nothing else 5o if we--or the systen-- 
are tola that Tl has an eratttcr, we ftr? perfectly justified in assuming 
th.il Tl is a transistor, and can create an IE-A link saying SO-, This Is a 
relatively trivial piece of digestion, 

.things ire more difficult If w» are told that "VI is a WHEEL of X* B 
All sorts of things have wheels: cars, bicycles, even clocks, So if we 
look; above the VUEEL node we find lioks with DF-pronus running 1 off to 
dozens Of other nodes- X might be any one of these. All we ran do T in 
lieu of further intonation, is to assign X to a class general enough to 
contain all the po^sibilities--rtA^-HA£f^-PllJcCT, perhaps. If, later + we 
learn more about X or more about the fcinrf of wheel VI is, we c^n then novo 
X down to a nore specific category, I><riflifltf wheels, for instance, appear 
only on bicycles. 

The second methanol?, is more direct, Certain roles cone in 
reofprocnit pairs: hu^band-wiFe,. parEnt-of fspring, owner- property, etc. 
These paired nodes are explicitly tied together by a nechanisin \ will 
explain later. Now, whenever the systen assigns a player to ofia role in b' 
pair---* is the PARENT of YV for in5tflnce--lt must immediately create 
another lihX assigning tho owher to the reciprocal rolfl j -in this case* B Tf 
is the OFFSPRING of X" . Each of these roles, of Course, carries its load 
of properties and represents a potential clash. This use of two links 
seems rather wasteful, but it gets the job done neatly r Note that if wa 
know the sex of either the parent or the offspring, we would move the 
individual in question down intp one of the mandatory sub-classes based on 
sex: SOSJ or DAUGHTER, MOTHER or FATHER. Note, too, that the reciprocal 
pair of roles say not he imnadiati superiors, but night be somewhere up tho 
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tree. Still.' the starch tofcia only one sweep. 

^ nrJl -r CES ™?f " r thiS es P lalni hc ™ w * ara to represent a relttion like 
GREATER- THAW, which doo-i not fit Into the OF format. Such thing* ere 
reprftiented by 4 mora frane-llfte structure which I will Explain several 
sections farther nn, after more machinery has been developed. 






11. Accessing formulas 

If I want to direct the system's attention to one oT its internal 
nndes--perhaps so that I can till It soraf new fact about this nnde-1 have 
to find some way D f specifying which node I mean. I do not have access to 
the noma's internal serial ntn*er. The node night or might not Have an 
unambiguous nane that is tnowra to both me and to the machine. If no such 
name exists, hpw am I to point out the no tie in question? 

The answer, of cu.r-ss, i.'. to construct a phrase that describes tho 
location of this node in tarns of other nodes that can be specified hy 
nana. Returning ta Figure 18, I might specify the node El by the phrase 
the emitter of Tl*, rather tharr by its name. Either fern is completely 
unambiguous, and I indicate that I intend no ambiguity by my use of the 
word "the". I might instead specify 'a ternlnal of Tl" Which would refer 
to El, Bl, or CI. If I .spoke- of "the terminal of TL" the system wwULd 
become unhappy: the word "the 11 signals that it should find exactly one 
node, but Instead n finds three. It would then have to ask which terminal. 
I mean r 

[ call such node -specifying phrases ffcetsainjj fvrmUs . Enne other 
examples wuuld be 'the length of the nose of Has'* Grandfather 's mistress*' 
ur "the mouse that murdered the cat that guarded the cheese In the house 
that Jack hutlt". The production and decoding of such formulas is one of 
the major tasks Of an? natural-language sjsten, and is relatively 
Straightforward in an OF-linfc system, in this section w will b? concerned 
only vlth phrases made from italic relations; verbs lfke " mU r d-ered " and 
"built" will have tn be deferred until after the discussion nf content 
mechanisms . 

Lot us first consider ho* to find and mart "the terminals nf Tl" in 
the structure df Figure 12. first, we will assuno a trivial mapping fron 
names llfce TERMINAL and TL to the associated concept mxl-js. [We will See- 
how tn use context to separate multiple word-nn-anihgs tn a later section.) 
Our first impulse might, be to send a command to all links Of the form H ? 
is a TERHIUAl or Tl' to r.a-k their player-nodes. This will not work, for 
there are no such links. The TEWlm link is attached not to Tl, but to a 
superior node. 

A better plan is to mark all of Tl's superiors, and then mark 
across any TERMINAL lints connected to any of these. But this is still' not 
right] we have marked trfiTTER. BASE, and COLLECTOR -not the desired E1 T 
Bl, and CI. Irfe have to move the markers back cown to the level of Tl, but 
we can't just sweep dowaiurard from the nodes we have already reached. That 
would mark the terminals of etrery translator, not just Tl . The proper 
procedure is to move the markers downward over only those links whose OF- 
prangs are attached to nodes that we marked on the way up. This will bring 
the markers hack to the proper level--nu farther --and keep them froel 
wandering off Co unrelated terminals. The markers go up the left side fl f 
the ladder, across, and down the right side. This is called a ladder 



SUBEf , 

Sometimes the markers will net make it all the way back down . IT 
we ask for "the MATERIAL of El" we Kill get COPrEA. U« could create « new 
node below COPIER to represent 'the COPPER of E]" but there is no point in 
this unless we havg something to say about lt--that it is very pure for 

example. 

This raises an interesting paint: in general, nodes are only 
created AS they are needed. 1 know that every person has a liver, but if I 
have ten thousand person-nodes in ny hetid, I da not necessarily have tan 
thousand liver -nodes. I only have liver nodes for those livers that r 
happen to know something About. And yet, if you tell ne that Clyde's liver 
IS purple* it is A Simple matter to create tho node LI and assert (LI is 
the UVEA Of CLYDE) and (PURPLE is the COLOR of LL). Actually, the LI node 
would not be given the name "It" or any other nflne. It would lust be 
"Clyde's Liver.' 

Long chains of these relations should in principle be no harder to 
follow. If we have 'the length of the nose of the mistress of the 
grandfather of flax" we sifijiiy use ane ladder sweep to get Tron MAX to the 
node representing his grandfather, another to get to the mistress, and so 
on. 1 am assuming tTlflt the system can convert "flax's grandfather h to * the 
grandfather of Kan" without too wuch trouble, 

Vhat if we ask the system to mart "all men whose grandfather's 
mistresses have long noses H 7 First we mart all men. Then, as above, we 
send out a Chain of markers from each man to his grandfather,, then to the 
mistress, to her nose, and finally to tht nose's length. These steps can 
be dona for all men in parallel, Some of these chains will end on the node 
LONG and Others on the node SHORT. (He are assuming quantum noses here J 
Many of the chains will die along tha way: some grandfathers, probably had 
no mistresses --at least ones that Che system knows about- We then simply 
place a new marker an LONG and propagate It back- along the marked chains to 
the original men. &o the men wliose chains ended on LONG become marked, and 
the rest do not. This is tedious, but not unreasonably so. given the 
problem. There are other Earning strategies- which would work equally well. 

By now, a picture should be emerging of how all of this night be 
used in a recognition program. If we- are fared with a creature that has 
webbed- feet, a flat bill, and lr ride scent green feathers on its head, we 
Simply mark all web-f noted creatures with one bit, all flat billed 
creatures with another, and all green feather-heads with a third, then look 
for the intersect ion--the set of all no-des with three marks. If we have 
more features than marker bits we can mark a few Teatures, Intersect, mark 
the still-viable candidates with a single hit, and repeat until we're done. 

Of course, this intersaction-flnding is net the whale *tory of 
recognition. One man's large nose may be another man's medium, and aside 
from such blurry boundaries we will often get errors and freakish 



exceptions- -the famous three-legged Cow, for example. Finding the 
intersection or properties is B y firy quirk apd Calrly rellahl(l Kfly cf 
getting an initial hypothesis, b«t w & still need to devote some effort to 
evaluation and improving the fU. Also, m fields like vision, there must 
be sane Interaction between the evolving hypothesis and the feature 
extractors. This representation Is a powerful topi for a recognition 

n^rai ^n^ "T ° f th * P ™ hlCm!i ™t""« *" ■* original working 
paper [1J still must he marked on. 

This Tast intersection is «. ? art of what I meant when f said the 

systeo felt right" as a modil of human recognition. Host people, wften 
confronted with a recognition t»sx p Feel thftt Che hypothesis emerges in a 
sudden flash of inspimtion-lf it comes at all. Before this flash is a 



period of aialess input gathering, end after it may be a period of fitting 
and weiring, hut there normally seems to he very little possibillty-by- 
possibility search, unless all else'has railed. I suhmit that the sudden 
appearance of a Single node at the intersection of a bunch of futures ijj 

about as close to a flash a-; « e are ever likely to get. In most other 
systems, including my suggest ion -demon netkwi r the finding of a hypothetic 
involves much more work than the subsequent verification, 

I don't have too much to say about the process of generating an 
appropriate accusing formula Tor a given node. It seems lite a relatively 
Straightforward process, though perhaps « bit more complex than the 
decoding procedure. In a way, it is lite giving directions to a motorist- 
hirst you tell him to go to sunt mutual! y-known landmark near the 
destination— in this case a node with a nam that he knnws--&nd then you 
give hin the series of street names corresponding to the best path from the 
landmark to the flcial. This is something of an art; the host path H the 
one most easily followed, hot necessarily the shortest. You might describe 
certain Intersections along the wa y. so that the traveler can verify his 
progress. Thus we misht have "the length of the nose of Has ' s 
grandfather's t/cun 9 Austria mistress.* The adjective may provide the 
listener with new information, but If He knows (or knows of 1 the lady they 
will instead provide a redundancy useful tor checHihfJ whether he is 
following the path properly, 

Obviously, if the person creating the formula is to be so 
considerate of the listener's needs, he mm haw a good model of the 
listener s lhfornation network, The words and the nodes used to anchor the 
rorrmiU nust have a meaning for the listener as well as for the speaker 
Speaking to ny brotHer I might say "Champ's mother", but to a stranger I 
would have to say "the mother of the German Shepherd my fanlly used to 
own. 1 must divide nil of my knowledge into packaqes on the basis of who 
might know any given it eh- everyone, just my family, all scientists, all 
n.I.T. students, and so on— «id 1 most operate nithin the proper subs-t of 
these packages when framing an iterance for some particular audience. We 
win see a possible Implementation for this in the section nn contexts Pf 

if" Mr*,^^ 5cratclv * d thB »urr aC B of the formula-generation 
problem; this looks like an interesting thesis for wmebcdr 



12, Handles and Itf-Unks 

In the next few sections I will describe fl number of embellishment! 
to the standard OF- 11 nX . These new mechanfsns are i in general, not 
designed to represent new properties of real-world objects. Rather,, thay 
implement what, in ny previous working paper, ] called the ttiiXitiini 
i nfo rrtff t i P i» In a description: statenents about haw the descriptive 
information is ta he inlerpretod find used. Some oT these new mechanisms 
may seem to he wenklY motivated at first r hut they will be very useful in 
certain applications we will encounter Latsr . 

Before proceeding, I should point nut that once links have reached 
a certain levol of complexity it becomes possible to Simulate some Of these 
mechanisms. For instance, instead of introducing a four -pronged link, it 
miyht D5 possible to 90t the same affect using a pair of three-pronge-d 
links. In deciding what new 1 J tik - typ es to present hare, I have tried to 
Optimize for 0-aie of under standing, introducing new nechanisns where they 
seemed to represent natural and. often-used relation*, hut hot for 
par t i l- i ■ " i- tfuirty catttS, The boundary is largely a natter of taste. In ffl 
hardware implementation the boundary would be a met tar of economics, and it 
might full ill a very different place, 

The first u r these new mechanisms is something I call the hflrtdfe 
node of a link- Each link CO*WS factors-equipped with a full-fledged node 
of its own. This, node can either be thought of as an Integral part of the 
link-unit or as being attached to a r/ourth prang- -the effect is the same in 
either case. 

This handle node represent* the iter* of information stated by the 
attached Lint, Statements about this piece of information can now be 
represented by simply attarhing the appropriate lints to the handle node. 
About a statement X, we can now say "X is a LIE" or "WOftLD-ALMAhTAC is th* 
SOURCE of K p . It is now a Sltiple matter to label the essential and 
incidental links of a mandatory node, In short, the handle gives us a way 
of getting hold of the associated link --hence the name. 

Hota that not every link can have something said about lt--this 

would lead to an infinite- p-'OUsion oF lints. We can not even afford ta 
give every handle node an identity linV-an exception to the rule stated in 
Section B. Perhaps e-vtry handle-node, by virtue of being a handle-nnrie, 
Should be considered to nave an inpl U\l link -Stating m X is d LI If It", but I 
doubt that this would mate much practical difference. 

We might he tempted to say that handle nodes are optional, that 
they art only attached to those links thai we have something to say about. 
This is Impossible, however., because the handle nodes serve another purpose 
as woil; they provide us with a way of rmrfcing sets or links. At any 
given instant, we may Mint only some subset of our knowledge to be active; 
the inactive links Should play no part in any computation- This allows Li. r . r 
for e^timjile, to have multiple inconsistent world models represented in the 



same knowledge, net, but using diiTeirtrht sets of lints. By raarfcintj ortO bit 
1n the handle nodes of tlia active links, and hy ordering that links net so 
marked ignore all CPU i n struct inn* , we can achieve the desired cTJuCt- We 
will see In the Section en contexts haw such activation markers propagate. 

Actually, we will see a bit about this topic right now, as hs 
consider the TV- link [ pr , sonetiiies, the J *- pro itg )' . Every one Of our 0F- 
Links has yet another prong, running off to a node called its co.itcit. It 
i* along this prong that marker 5- travel to activate the IlnX. Normally, if 
a link's. Context is activated, the link Hill be activated as well. 

The relation between a piece of information andi its content Is 
normally specified by the English words "in the content of" or just n ih n , 
Thus ne have "ABRAHAM is the FATHER of ISAAC in the BIBLE" PT "GRAVITY i* 
an INVERSE-SQUARE- FORCE iip KETVOM AH- PHYSICS", U we are (1 is cms* in a some 
other book or Elnsteinian physics, these particular contexts would not- be 
activated and; theiG pieces oT IttFoniation would play no part in the 
processing, There is very general context, GENERAL -KNOWLEDGE, that 
contains those facts that have; n-^ pVane el&e to live. The context nodes 
themselves are tied into a tangled hierarchy based upon the relation "is a 
sub-context of rather than "is a kind of*, but that's an issue J don't 
want to get into yet, 

Mote that a Frane (in the Minskian sense) Is a kind of context t 
binding together a group of relations, Thus we have "MARV is the MOTHER of 
CLVM in the JOKES-FAMILY 1 " or "HURHA1T is a BASSOONIST in the B0STON- 
SYrtPHONY -ORCHESTRA" or "SUSAN is the GUEST-OF-HOMR at the PART? - . (Well, 
you can't win -them ail! I think that "at" replaces "In" to flag a 
particular spatio-temporal contest, hut this is tricky,) 

Sometimes it is hard to know where the boundary Jbctwecn tiF and IN 

Tails. Is the crankshaft a part of a car or a part in a car? Both. 1 
suspect. Ihis question will he treated at length later on, as will the 
whole issue of part-whole relations, In some of the context schemes I have 
tried it Is useful For a nods to have many IN-nrongs, In this case, we 
don't have prangs at all, but separate [$- li it*j running between the 1 ink's 
handle uvtle and the various context nodes. This, too, we will cover later. 

In fact, I have said all that I really can about IN-links -without 
opening up the whole context issue, and we aren't quite ready for that yet. 
] Just wanted to give you a quick look at the machinery that exists to meet 
the context problem, so that it won't seen too strange when we do need ic, 
and so- that I can sneflk a few IN- links into examples in the meantime. 



13. Exceptions 

This entire descriptive system is based upon the principle that it 
is rnn n, r 1 ci ,„!. [>r a., i i : l v l -:!■:, : l0 inhibit a la,-,; (; -„ ::i - n f |,r:, unties 
TNinl *ih impropriate Sii^rinr class than to state oil of an individual ' s 
properties directly. finch Of this advantage is i ost if the entire »t of 
properties nuist be used as is, without any modifications. The most 
valuable classes -those wttft the largest bundle Of properties-would have 
practical ly no members. In the system I ha^e described, It is trivial to 
add new properties but somewhat harder to cancel out inherited ones. 

The tangled hierarchy system eliminates sone nf the heed for a 
property-cancelling nechanism, Let a s assume that all er the cows w c have 
ever seon are .black. This color is attached to the COW node e<m is 

i::h- iterf hv all indivmi,.,] :0 ws. Then we sec .1 brown cow. Instead or 
trying to cancel the BLACK property and Add BROWN, for this individual, we 
can reorganize the CQW node as. shown in Figure 13. Ue now have two kinds 
of cdws, black ones and brown ones. Botti are perfectly legal classes hot 
exceptions. The rest of the COW properties remain Kith the superior COW 
node and are inherited by both types of COM, The exception has been 
n o ma i tz erf . 

Norma lizat ion has its placer hut it is not the whole story For 
one thing, we would be reluctant to change important high-level nodes every 
time sume random exception COmes along. Itngine, for instance, a feathered 
hippopotamus. You hava never thought or such a thing befnr*, and ne^r 
will again (if you are lucky). Is it reasonable to 4UPJS0SB that for the 
sake or this Single image you have permanently divided the class of 
hippopntumi into reathsrnd and non-feathered varieties? 

For another thing, the normalized: sub-classes are loo equal Often 
we uant the system to assume same specific default value for a property 
unloss this default is specifically contradicted in the description You 
may fc now that albino elephants e*isC r htlt if I say - c 1 6 phan t " to you, you 
will almost certainly think or a gray one. It is possible to label one of 
the sub-classes as the typical one, and to place new class-members into, 
tots sub-class, but this become* very clumsy if a class has many default 
properties. 

■ 

So we still need a true exception mechanism: some way for a. aiven 
node to cause certain superior links to rmain silent when an access is 
narie to some property of that node . To achieve this, we have a new link- 
type: the azcea-t It* lint. (Actually, we could do this job with an OF- 

nfc. but I feel that the separate link-typo makes for a Clearer 
presentation .> The exception link runs from the node representing the 
exceptional individual to the handle nede of the link that is to be 
cancelled. Figure ]4, for instance, tells us that Clyde is a whit* 
elephant. 

Whenever We ar5 Bfr0lht tfl bejl[1 a ladder sw?ep t(j rind smo prot > erty 



coy 



LOVJS 



(V) BEF&frE RLOMAUtZtiTfJ/J 






. 



f 



toLOfi 



* BLACK 



8$0\*JA/ 



(A), AFTER 'H0AM#t24T/M 



COLOR, 




BLACK 



Js£c&-&u— Jhl^rur*% CiTMrt^, 



COLOR 



EL£ 




K/^/rr 



ctyDs: 



{ft* ** > 






r*c^ccsigs- iq - C&a**^ *•** ** ^u^LtS&s ^U^**w^ 



£L£ftt#At7 



- 




AL&fJJO 




£L£?tiAtfl 


{■ 


r- / V^jT 




V ;- i i* *- 




WtilTF 



/4 






F4s$AxJl*£* . /£" - ' C£*fJs~ X& &->&- foCS-i***-* j£&C&$wZ y 



of CLYDE, we First send out markers over CLYDE'S, exception lints tg set a 
cancellation bit in the handles *f the cancelled superiors (or perhaps to 
clear an activation hit). Then the sweep proceeds as usual, except that . 
the -CPU commands. are addressed only to Ron-cancelled links. Note that the 
cancellation signal muse re-tch. a link be Jar* any narkers have crossed if 
it wm.ld l)« very hard to track down and neutralize all of the propagating 
descendants of an illegally- pas serf marker, ■■ 

In fact, the Above picture Is ovcr-iii«»liried. An exception tan be 
anchored Co a class-node as well as to an individual node, arid it should ba 
inherited by the class-members, just like any other property In Figure 
15. for sample, We see the clan or albino elephants, of Which CLYDE is a 
member. Note, too, that because of this systea's habit of some tines 
expressing properties in terns of group membership, an exception link night 
have to run fro* a node tq oile of its own superior 15-A lin<s. This looks 
dangerous; *e have exception markers cutting off the path to superior 
nodes, and superior nodes-in mid-sweep-gencratlng their own exception 
markers. It would appear that the only way to avoid potentially chaotic 
races between markers IS to proceed carefully, step by step, First the 
exception markers arc sent DU t: then, over the still-valid upward^links 
the first layer of superiors is narked; then, the exception markers go out 
from these nodes i then the next layer of superiors 15 narked t . and so en. 
lUiS IS orderly, but now an upward sweep takes twice as long. 

Can the exception and superior marking steps be done 
simultaneously? I think so, since a node would have no reason to cut its 
own imtedtutely superior ISA links -any more than it would have reason to 
cancel its own properties-but ohly those links oapae one of its superiors. 
Thus, from any given level , w would be sure that the exception narfcer 
would reach a link in the current step, and the regular markers would Find 
the bridge already burnt when they arrive one cycle liter. There is still 
potent ml for trouble if tnere are redundant paths of different lehaths to 
a superior node, but this is a perverse situation and I suspect that it can 
be dealt With by forbidding suctl redundancies where possible and by adding 
Kludges where Necessary, 

Given an efficient exception tiechanism, ■ we can afford to make 
liberal use or default assignments, with all the advantages Hinsky has 
claimed for them, and e*e«pl*rs of the sort I described in my previous 
paper The various links in a description can be labeled according to how 
reluctant the systea should be to take exception to each Rone may be 
sacrosanct: no individual may alter such a node. Others may be mere 
default conditions, 5U ch as tte red color or an individual's Image of BALL* 
these can be changed with conplete impunity. Such properties are of 
course, attached to the handle nodes of the links in question. fh«» 
dfScrejMrrctf value* play an important role in recognition: The ttore 
exceptions an individual mist make to Tit into a particular category- - 
especially important exeeptions-the greater Is the likelihood that the 
individual mould be happier somewhere else. 



14. Iimediate Connection 

i 

There are really two distinct senses III which properties «incl 
memberships can be assigned to a node. Thi-e first is tit* Sense we have seen 
ir: .ill n' the examples in i .:; -.h= r i" r: [■ :: r : , :-.\ .11. ! n<.'-&-nrsi ips p.: tached tn 
a node are meant to apply tn all of the inferiors of that node. In 
addition to this, however, we need a way of s ay i*ty things about the /rod? 
l£sef/--about its characteristics as a group or about the way It functions 
As a role in a. larger description . For some reason, this distinction was a 
very hard one for mo to grasp: it was the first of these auxiliary 
mechanisms to be developed and it Caused me a great deal OT trouble until I 
figured nut what was, fioing on. 

Consider, far instance, the statement that a per Sen has two eves., 
we- Bight represent this as shown tn Figure 16. (The wiggly line is an IN- 
lifili.) But if the number property were connected tw the EYE node in the 
usual way,, each individual eye would Inherit the property of twoness. This 
IS clearly not what- we intended by this statement. 7he twoness refers to 
the EYt node itself—specifically, to how that nods is to be filled in the 
content of a particular per.<ipn--and not to any member of the class EVE.. 

To represent this distinction, we create a nan hind of linX-to-node 
connection., which I will call fmwditftr connection. In contrast to the old 
kind of connection, which is meant to he inherited by subordinate nodes, 
iBPtedlat'e connection indicates that the property or nembership IS meant to 
apply only to the node in immediate contact Kith the linfc, in that node's 
capacity as B group or role, I prefer to thitik of those eoutturction arnjoj 
as being a property of the connection ltself--perbaps the link unit prang 
is attached to a different terminal of the node unjt--but it Could just as 
easily be an "inmediacy- bit 11 associated with the prong or even a distinct 
family of lint units. In the digrams 1 will represent immediate 
attachment hy a double Chevron near the point Of lint-node contact, as in 
figure 16. 

It is up to the various access inQ programs of the CPU to treat the 
two connection senses differently, During ladder sweeps and other 
property-accessing operations, only the normal connections are of interest. 

The immediate Connections are consulted during the various digestive 
processes of the system when, for instance, the possibility of adding 
another EVE node to the CLYDt description is being weighed. This is not to 
say that wg can never use a parallel sweep to find immediate properties: 
we might, for instance, want to list all the parts of an elephant that ecus 
in pairs, But the inmediate connections stay out of the way in normal 
property -finding sweeps. 

Imnediate connections can be used to represent many things, As we 
have seen, they provide a way of indicating how many players a role may 
have in any given description. Similarly, we can label certain roles as 
being optional, SUCh as a moustache on a man's face- Some of the 
mechanics we have mentioned earlier, such as the labelling of certain 
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nodes a* mandatory nr exclusive or the statement af a node's reciprocal are 

Also Cftsos or immediate attaclutenL. A group may be labelled as empty or a 

member of a group may bo labelled as typical. A node may be tapped as 
representing a group op an individual in a .similar manner. 

This whole .business of individ^lflls is mare subtle than It might 
appear. I * U s tempted ,tl first to nfl ke all of an individual 's properties 
connect immediately to the individual's node, After ill, there can be no 

question of these properties being inherited by an inferior node, for 
Individual nodes have no inferiors. ^The dlfTf . r ent appearances of an 
Individual at different tines could be treated ns inferiors nf that 
individual's node, but I hav e faund the context system to be more useful ■ 
for representing the changing properties of an individual.) 

Gut we can change .in individual node to a class with surprising 
ease, as when wo refer to someone as a Hitler or a George Washington. The 
boundary can often be very blurry. Is Lassie a dog or a kind of dog? I 
understand that there were many dog-actors *ho played this role over the 
years. Tl may be a specific individual transist.:- in a circuit diagram, 
but if that circuit is manufactured, each unit will have its own version oT 
Tl r and some of these may have exceptional properties. So the 
individuality of a node, may change from context to context. 

this being the case* I decided that to irprcss individuality upon 
hundreds of incoming property links was. a misbake r It is no harder to use 
normal Connections on individual nodes, SO that to create, a metaphor the, 
system merely has to hook in an inferior node and Create an exception to 
the Single INDIVIDUAL property of the superior. I do not yet have a good 
answer for the question of how we know, for exanple, that when I tall 
someone t Hitler I am referring to his personality and political 
philosophy, rather than to his blood type or place of birth. Metaphor is. a 
cnmpLex nental operation. 

There nay be a few oore uses for immediate connections that' I 
haven't really worked out yet. Consider the statements "a resistor is "a 
component in cE<:ctro??icj' and "a crankshaft is a component UT u cor" If 
vie have a specific resistor we are still in electronics, but if we have a 
Specific crankshaft we are -in the context of aoaw particular car. In one 
case we create an instance and In the other Case we don't. Perhaps this 
difference can be flagged J.>y connecting the IN-linfc immediately to 
ELECTRONIC^ and normally to CAR, tot the context system \s still too 
muddled for me to be- sure of this. 



15, Mode Names and Speech Aecogn i t \ on 

At this point in the presentation it would be nice to pull 
everything together and demon strata its operation in a Tew extensive 
examples or italic description frames- those that dp not have p. need Tor 
multiple contests to represent tine-varying features. Examples of this 
typo night include the description of flu electron i c network « web of 
rurally relationship, or the description of a disease in term* Of its 
symptoms. Unfortunately 7 I do not have any very complex examples worXad 
out yet. The tools I have described JO far are still new, there are Still 
some pienes missing (minor ones, I think), and the unsettled state of the 
context system keeps sending tremors through everything else, since it t* 
tied to the format of the basic link. Once the context ness Is 
Straightened out, the development of such examples will he ray first 
priority, 

I Would, however, lilt* to present One Baffle that is. at least 
partially developed - the medianlM for associating na»es with nodes. This, 
will involve son* hand-raving, but honeruliy not an intolerable amount. 

The first point to be made is that the node representing the 

concept COW and the node representing the word *£ptf" are distinct, though 
linked together. A COW has four legs and eats grass; KQU" has three 
letters and rhymes wit* "howV COK 1S-A BnJIHAL; "COW" f5-A NOUN. "COW* is 
the mm of COW, A- NAME IS-A VORD. ttW is the LEAKING of "COW". And so 
on . 

A concept node may have many nawe nodes or none at all. We hav* . 

seen how accessing formulas can be used to reach unnillMd nodes or those 
whose name mlyht not be shared' by both the speaker and the listener I 
would guess that less than ten percent or the nodes In a person's head have 
naniGS--assiimihg, of course, that people have nodus in their heads. Unless 
It is a nonsense word, every word has at least one ne«ninp; some have-Bany. 
We will see later how the context system can be used to eliminate this 
anbiguity In most cases, and also ha* multiple languages Can be handled. 

We must attach to eaclv *ard nnde a spelling and a pronunciation-t- 
one a sequence of letters, the other a sequence of phonenes. There are at 
least two possible ways to represent such sequences . One way is to use a 
Baster WORD frame Kith perhaps twenty role nodes represent ing ah solute 

™ r / D ^ tl0nE; / CR3T " LErTF ' R ' SECOHD-LETm and so on. The spelling pf 
«W" is then easily indicated hy filling these roles: C is the FIESf- 

™n °L C ° W " h ° 1S the SECOND-LETTER of "COW", U Is the TM1M-LETTER of 
tow . The pronunciation could be stored by a similar method. Very long 
words could be broken up and stored as a sequence pf sequences. 

Such a structure may have its uses, but I don't really believe that 
people use absolute-position schemes for storing spellings or 
pronunciation* (except, perhaps for a fen crosswrd-puzzle fiends and 
Scrabble hustlers). If we did, it would be a staple matter for US to list 



every word we fcnow that fit* the pattern -AT-E-Y. sinply by Intersecting 

the sets of ward* with thr^ particular Otters in the specif led positions. 
An^ word node that collects all four marha i 5 a winner. {Did you think of 

x „i? r V J . , l ' most p * ople " nr),jl even ul1 s™ th e seventh letter 
in Mississippi' without counting. 

All of this suggests that these sequences night instead be stored 
in a list structure wish a specified first member and a string of other 
members linked by 5LKXEMOR-0F relations (see figure 17). Mote that the 
inriivi .-....,: let:, r5 in ■(,:)■«■■ .-.re n-.l. the alphabet letters themselves but 
fFtitrircu of them. This makes it possible to speak of "the second £ In 
rJississipni - as a distinct entity. 

The list-structured seqjence has same important advantages in 
represent ln S phoneme sequences. Speech is an irregular fnconliia stream 
and a burst of noise might cover an unknown number or phonenes. This sort 
Of thing would wreak hftvee up«n a system tied to absolute letter positions 
ine list structured system, on the other hand, could pick up the next 
intelligible sequence, locate all wards containing that sequence reaerdlejj 
Of Its positioA within the tforrf, and proceed from there. 

Consider hOMf the system might recognize the word "today" as It la 
usually raijnbled. The inconing phoneme sequence might look, like this: T- 
saund; son nondescript vowel r T or D sound; long A-soiind . The CPU orders, 
every word node to mar* Us first phOheme none if that node Is a T- sound. 
The mark U passed to the second node if that node ts any member oT the 
vowel class; otherwise the mark is erased. Then on to the T or d, and 
finally on to the long A, if this is hot the end or the word, the mark is 
killed anyway. Probably only one mark will have survived the journey 
especially since we may have ore-Selected the original set of words ' 
according t& part of speech or subject area. The mark, is then Sent hack to 
the wos-U that spawned it, and we have a winner. 

■ In Effect, the strina of phonemes attached to each word-node Is 
acting as a finite-state acceptor ror the incoming strean, and all of these 
accepters are acting in parallel. If the governing CPU program is Smart 
enmigh, these acceptors can be quite flexible In dealing with surh thihgs 
as indistinct ward boundaries. One set or marks cflh continue on with the 
o.d vi. u. h-md,., M-.jiR ;„„Hher s*1 .',,:-s rr-.;n irs haw m run 7 of „h..t night 
be a new ward. Both sets can be stepped along at the jftme time until one 
or the c.her dies nut. This does no: necessarily hflppen in strict real- ■ 
time: the meaning sequence is almost certainly buffered SO that the Systea 
wn recover Trom bad feis i ons— an over-jealous pruning of the initial 
possibility set, Co-r instance. Obviously, it will take a lot of work to 
mpiement these v Jpe i ueas , but this system does seem to make the task 
Bore manageable. 

It is fun to Speculate about this sort of system. Perhaps, for 
instance, the concept nodes live in one part or the brain and the word 
nodes live in another. [Femember my earlier speculation about the use of 
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neighborhoods to save crrcssbar cajia.ci.tyT) Suppose, too, thflt the supply of 
direct connections between the l^g areas is inadequate Tar modern needs h 
that it nets used up in early eti i 1 dh rcci d , It might then he very hard to 
form a new na**e meaning association quickly, and the associations that are 
formed might be very indirect and unrel]ahje r like a phnne connection from 
Boston to *|flw York b¥ w ay OT Alaska, This might explain the plight of 
people like me who can remember both names and faces, but have a terrible 
time keeping the twg tied together. The list -structured form I have 
suggested for words night also explain why, when we can't quite remember a 
Hord, It usually comes back if we can get the first letter. The second 
letter, unless it is very unusual , gives ns much less help. Such ideas art 
not te be taken seriously, however. 






15, Th* Content Hierarchy 

The word "conteXtV as \ have beei using it in this paper, refers 

to a nunher of related topics, First, there is what r call oftjoftrtc 
cojrtsKt: pieces of information (links) can he valid in some contexts and 
completely inoperative In ot*iars. Ihis it similar to the use of "contexts' 
in COHUU'ER [10] to allow multiple inconsistent wo r Id-models to co-exist in 
the same rtata-ba.se. Then, there is the use of contexts as habitats. In 
any given Context we will expect to find certain thing*, and these 
expectations can be an inportant tool in the di Iambi gnat ion of inputs. In 
a 2oo, one is predisposed to see liens, tigers, and elephants; on a farm, 
one expects cow* t pigs,, qnd. chickens. Finally, thera is the use of some 
sort of context-relatad grouping mechanism to create complex frame-like 
structures of wholes, parts, sub-parts, and all of the relations that tie 
those parts together. 

Taken as a whole, the context package is by far the least-developed 
part of the system. At -present, I have some ideas about hpw each or the 
above -mentioned context e Fleets, can be achieved separately, hut I hflvo not 
yet found a way of pulling everything together into a coherent system with 
well-defined areas of responsibility. \ don't thin* that I am too far fron 
such a synthesis, but it did not seem wise to further delay this, paper 
while I work on this. .So what we will see in this and the following 
sections are a collection of fragments that loek to me lite pieces or the 
answer, but that do not fit together Very well. They should, at least, 
serve to illustrate what kinds of things need to be done in this area, \f 
not exactly the right ways of duing them. 

We. will begin by considering- the absolute COO tent system. &y 
■absolute", I mean that in a given context .a fact in either present or 
completely absent—never anything in between. This is different fron the 
habitat system, which pushes certain items into the foreground, hut which 
never completely rules out aiiy possibility. As we will see, both systens 
use the same context hierarchy, hut In different ways. 

We have already seen nos.t of the nachiuery that we will need for 
implementing absolute contexts , We have seen how, by setting or clearing 
certain bits in the handle-node ef a link, we can label that link as active 
or inactive, We have seen that the CPU can Specify, In Its COranands to the 
lin'k units, that only those links marked as being active should respond. 
We have seen how activation marfcurs can be passed along III- links from a 
context node to the various links that reside in that context. What we 
have not seen is anything about the nature of the** context node* or about 
how an appropriate set of them can he activated at once, 

1 think that we want to use the sar*e nodes to represent both 
conceptual entities and- contexts. Consider a node like TLXA5. It is a 
perfectly good conceptual node— a STATE of (and ta) the U£A--with an 
appropriate set of properties: ait area, a population, a capital, and so on. 
Tat TEXAS also functions as a context; ii! TLXAS certain lews are in effect. 



and certain, other facts, are tr"iie which are not true everywhere- ]t would, 
of course, be possible to create distinct (but Connected) nodes for TtXAS- 
the-thing and TEXAS- tbe-ton text, hut I don't at present see any advantage 
in this. As long as the CPEi program is able to keep track of which marker 
bits it is using to tag active con Vasts, end which arc being used to trace 
.*ut properties, there should he little danger or conTusion. To its 
superiors, inferiors, and properties, TEXAS ts a thing; to the facts 
attached to it by Ill-links, TEXAS is a context- 30, Tor now, let us assume 
that every node is potentially both an entity and a content, though some 
no.des might not make any particular use of one or the other Of these roles < 

Context-nodes can represent many type,"; of grouping. Some Ore 
spatiali a given fact might apply in Texas, on the noon, in the desert (»HU 
djesert), or In ny office, Some are temporal; a fact may be true in IS4S, 
in tUtr Nineteenth Century, fini (any) Sunday, or in the reign of Hammurabi. 
Sane contexts refer io various subject areas or to Other conceptual mini- 
worlds, real or imaginary; a fact might be true in chess, in Newtonian 
physics, in war, in War and Peace, in Greek mythology, or in Clyde's 
opinion. Note that most of these contests also serve as entitles, with 
their own IS~A links, properties, and so on. 

So we now have a large and varieri set nf contCNt nodes. Each piece 
&r information is hung in sons contact by an IH-link i and it becomes active 
or inactive according to ho* we have narked the Context node. Inactive 
links are completely out of the nay—they have no effect on processing 

speed. 

Does this solve the problem? Not really, It will very often be 
the case that two contexts will differ in- a few facts or a few doscn, but 
tv;11 havn m,-my thousands of facts in cenmon , [Ms Is especially tr r ie in 
the representation of the sequential stages in a narrative or In a plan 
dcuoloped by a problen-solvjug system, (See [3 J for examples.) It would; 
obviously be wasteful to re- copy each of these Shared facts into every 
context that uses lt p or oven to encurtber each fact with multiple IN -links* 
It it much better to include the shared facts in a single large Jlfjfer- 
contejft T to which the sharing contents can be attached as aui-conteifcs . 
Each SUb-context inherits all of the facts in the super-context, except 
those which tt specifically cancels ■ the sub-context may, or course, add 
new local Tacts of its own. (This Idea is descended from the COJUI]V£R data 
base [10], by way of ny own packet system [4]. ) 

TEXAS, then, is a sub-context of tfSA; ftALLAS, In turn, is a sub- 
context of TEXAS- Anything generally true in the USA—that women can vote, 
for instance, or that slavery is iilesal--is also true in TEXAS, unless 

there is specific information to the contrary. Note that this inheritance 
of facts from a context to its sub-Content is not the same as the 
inheritance of properties ninny E5-A links: the CAPITAL nj the USA is 
WASHINGTON the CAPITAL of TEXAS is AUSTIN. Uxe the IS-A relation, the 
sub-context relation is both directional and transitive. 



All nf this suggests that the sub - con t ext relation forms Its own 
hierarchy using hardware sufo-context (SUBCON) links . This hierarchy Is 
distinct from the I5-A hierarchy; It has its own lints, but it uses the 
same collection of nodes. Since we have usurped the up-down direction for 
the IS-A hierarchy, we win speak dF the SUBCOM hierarchy as running left 
to right, with Che more inclusive contexts to the- left: USA is to the LeTt 
of TEXAS, while DALLAS Is to the right] 1S1Z is to the right of NINETEENTH 
CENTUM. The system sweeps markers leftward from a node to nart all of its 
super -cori texts, and Mgiltward to mark aLl oT its possible sub-contexts ^ 

To activate a given context, then, we simply mart it as Active and 
sweep the activation markers to the leTt, marxina all of that node's super- 
con texts as well, The Links hung in all of ttie marked contexts arc then 
Activated, and this is the set that is used in any subsequent computation. 

Recall that under certain unusual cf rcun5tancs*--for instance, to 

rind what color cows are--we had occasion to sweep property markers 
downward From a node. -Similarly, we will sometimes have reason to sweep 
activation markers riqhtviartt from ft node. Suppose, Tor a sample, we want to 
know if casino gambling IS legal in the USA. The system would first 
activate the V.ZA context normally by sweeping Leftward, but would find 
nothing relevant to the question, then it would mart rightward, activating 
the sub-contexts of USA, and would find the answer; legal in NEVADA, not 
leg&L in other states. It seems unlikely that the. system would ever want 
to compute in this condition, since direcUy contradictory sets of facts 
would be active simultaneously. Ue will see some other uses for ri-ghtward 
sweeps later j in the section on habitats. 

It seems clear that this SUBCON hierarchy should be tangled . Vt 
night, for instance, want to Cr'jule a context rep-resenting the desert in 
Texas lTt the sunnier of some particular year, letting this new contOXt 
inherit all of the information resident in its disparate super-contexts. 
Wc can then hang in the new context any information valid only for this 
specific combination Of contexts. The situation is closely analogous to 
that in the tangled JE-A hierarchy, except that resident Information lints 
have replaced properties as the things being inherited. 

J am not sure whether the context hierarchy ends in a single 
leftmost node, analogous to the THIKG node of the IS-A hierarchy. ClEarly 
there are nodes Tor EVERYWHIRE and ALUAVS, the most inclusive nodes for 
Space and tine. Prnhably thei*e is ft node naeied GENERAL (or whatever) that 
encompasses all subject classifications. A REALITY node might cover 
everything that the system believes to he literally true, as opposed to 
FICTION or to the & I NC ERE- BUT -til STAKED BEL I EFS-OF -OTHERS. But exactly how 
tin:/.i- 1 1 ■ : 1 1 1 - ■ .srv ri: 1-- '. <■■: . nr,:! wh ■: f, -i ■ - '.: -y .mi- .^!| nuIi-m., ■■-. c.-^i.-.. r. [ ,, n wen 
«0Pe general node, is at present a mystery to me. I don't see what such a 
node would be good for, except to tie up loose ends. 

There are a few important points yet to be made about this new 
hierarchy. Fust, note that \J A is coirjid^red a fiirt 0/ B Vthtn A flftd 1 B 



ere treated <AS <?fl t i ti cj , fchcfl A is i sub-context of B when both are treated 
as content*- The Rattlo of Gettysburg, for Instance, Is a part of the 
American Civil War; the Battle of Gettysburg context is a sub-contest of 
the American Civil War contest. Anything true in the war saner-ally-- that 
the infni> try USi-i mu Kile-loading riMes, say-- is also true in the battle, 
unless it is cpntradietedr Once ngaiu, this is not the same as the 
inheritance of properties; the dumtluii of the 6a 1 1 E* was not four years. 
We will see more about the subject of parts vs., sub-contests in the section 
on rrarte -hui Itllng, 

The other point is that etrtrjf /5-fl Jin* /wflCtfOJTJ Cs if StfffCP* link, 
but that the reverse is not true, The Battle of Gettysburg is a ***- 
context, as well as a kind, of battle. Anything true in battle generally 
is also true in this particular battle. The Battle of Gettysburg is also a. 
SUBtON of wAfl, by way of the AMERICAN-CIVIL- WAR nnde and its upward IS-A 
link, CM LBS IS ft sub-context of BOARD -iiANES, and ELLFHAHT of ANIMALS t 
Thus', when we speak of a leftward marker sweep, we really mean leftward and 
upward; righLward really means rightward and downward. Ta put it another 
way, the EUfiCON link seems to be a weaker form of the IS-A link; SUBCM! 
can carry con text- re 1j ted markers but not those used for property search; 
15-A links can carry both types. This is a recent addition to the system, 
and I'm not sure I have it exactly right, but it is clear that sunething of 
this sort is needed. Are THIMG and u£N£KAL the same node? 1 don't know. 

There is a lot more thinking to be done about all of this, 
especially about how far we can push the analogy between the IB- A hierarchy 
and tha context hierarchy.. Are there exclusive sets of contexts and 
context-clashes? Mandatory sob-contexts? Do thu principles ouverninoj the 
growth and change oT the context net resemble tbose governing the IS-A net? 
There must clearly he a context -except ion mechanlsti to cbwwl the 
inheritance of a fact ["rem a super -co a text whan necessary i What are the 
details oT this? All of these are questions for the future, and until 
these details are worked out, the contest hierarchy will continue to be 
just an image, not a coherent theory. 



17. Habitat and R ec a gti 1 1 ion 

lp the. previous section we s»w hew cohtext mechanisms operate to 
control certain aspects Of the reasoning and data-retrieval processes, 
Cohtajit plays quite a different function In recognition processes- Every 
contest supplies us with certain expectations about the entities that 
inhabit it. These expectations can serve to limit a priori the set of 
possible descriptions against which an incoming stimulus may be matched. 
In most enviroiimoii ts , only a very small fraction of the potential set of 
descriptions will be considered. Of course, this pre-selectioti is rot 
absolute, wtien faced with a surprise, the system must loosen its 
expectations^ or abandon then altogether and proceed to make the 
identification on the. basis of sensory information alone- But in the 
normal course Of its operation, Che system will find that its expectations 
are confirmed in the vast majority of cases, and that they can save it a 
lot of work. 

■ 

Such a pre-selection system is oT ohvious value in a recognition 
system, that rarst compare descriptions one-fey -one to the incoming sample, 
looking for. a match. It i& less obvious why pro-selection would be useful 
in a system like this, which can simul taifeouj I it weigh any number of 
descriptions against the incoming set of features. But this assumes that 
the sensory processors have already assenbled a sufficient set Of features 
for an unanbigitenjs idtntlf ication r It is far more likely that the first 
wave of ihfomadon to arrive for an object will contain only a few crude 
features, aid that to obtain more will require a specific request to the 
sensory system and the expenditure of more effort. Clearly, it will take 
more and better features--and thus mare sensory effort--to identify an 
object from a very large set than fr^m a very limited one. Of course, the 
requirements on the set of features will also be influenced by how specific 
we want the identification to be and how certain we want to be that the 
choice Is right. 

So the mechanism of context-driven pr^-sclcction is what allows US 
to go through life giving only the merest glances to the majority of the 
things, around; us r To do otherwise would leave much less time for looking 
at the interesting or surprising things we encounter* A. knee-high moving 
brown blur In a city park is a dog-. A black compact S-inch blob on a desk 
is a telephone. Large colorful novlng blobs in the street arc cars. And 
so on. we are free to take a closer loot at any of these objects if wo 
want to, hut usually the gross features end the context are enough to 
satisfy us. 

The resolution of ambiguity by context is even more important in 
the recognition and understanding of natural language. Consider the 
foil owing two sentences: 



Ruth nent into Che locker roon to loik for his favorite hat." 
"Count Dracula went into the crypt to look for his favorite bat." 






Now, it is pmtty clear that Babe Ruth is seeXing a piece of wood 
and Eracula ■* flying ma-imal, but what is the nachinery that tells us this? 
Ha cannot look nore closely at the word "bar to determine which sort of 
hat it is n nor can we call up the author and ask. Clearly, the issue is 
decided by context.: the fust part Of Uie Babe Ril Ml sentence places US in 
a BASEBALL COO text, which is inhabited by wooden bats, but not furry ones; 
in the YAH r IRE -STORY content, the' reverse is true. In a neutral context, 
inhabited by neither flavor of bat, we would have to guess which cleaning is 
intended or defer Judgement until nore information arrives. The process of 
deciding -rt'nich context to invoke is at least as interesting as that 
context's subsequent use; we will see the details of this process later. 

To see how this habitat mechanise works, it is best to consider the 
most obvious form of the problem: the habitats of animals. At first 
glance, it appears that habitat is just another property, like sire or 
color. THE -EVERGLADES is the HABITAT of ALLIGATORS, and so pn. If we are 
try in; i t'j identify An animal from a verbal description, he would use the 
statcnoilt that it Lives in the Everglades just as we would use, say, the 
statement tliat it is green or has long pointy teeth; it is merely one- the r 
fACt to throw into the intersection ^finding process. In this case, habitat 
is a particularly valuable feature, since it is relatively hard to tell 
Alligators from crocodiles and caimans on physical grounds alone. (This 
assumes that we care to be this specific.) 

Usually, of Course, we do not have to be told that a creature 
inhabits the f-.vergl-ades, or wherever, Here commonly, we would assume the 
habitat property because we happen to be standing in the Everglades when we 
encounter the beast, or because its description appears in a newel whose 
setting is the Everglades, ("There, in the fetid water before no, was a 
oalevolant green shape, at least eight feet long, with row upon row of 
saber- like teeth. I reached for my Bowie knife.. . p ) So, while' we are 
physically or mentally operating within an Everglades context, we can nark. 
all oT the Everglades inhabitants and operate only within this set while 
looking for intersections of other features. Tnis is the rre-selection I 
described earlier. We can Leave this set of expectation markers in place 
Until we are ready tc move on to another context. 

■ 

The concept of habitat can be extended to incLude much more than 
anlrtals and their territories. Desks inhabit offices, oil wells inhabit 
Texas, unicoms inhabit uythology, mesons inhabit particle physics, 
biplanes inhabit World War I, the Plague inhabits lledievaL Europe, and 
Julius Caesar inhabits the Hainan Empire in the First Century B.C. An 
entity may inhabit many contexts; lions, for instance,' Inhabit both 
African grass Lands and zoos. Though we have not yet seen the detaiis of 
representing actions, it should be noted that these, too, have their 
habitats: jousting Jn the fllddie Ages, blowing out candles at a birthday 
party, harvest Uig ijrain in September. 

This view of habitat as merely another feature makes it easy to see 
how the system would handle surprises.. In my previous paper. 1 described 



how a recognition system might deal with one or two anonalnns features in 
an otherwise routine identification hy looking for an accuse. A cow might 
appear to be three- j r-cj ycj ij because one leg js hjdde-n by another, or it night 
havg stopped on a land mine. Fveji ir *e can't verify these excuses, the 
fact that s«ch plausible explanations exist gives «s sotie Confidence in 
3t).cMng to our judgment that the beast Is a cow, as long as it is a good 
cow in all other respects. Of course, if there were a truly three-legged 
cow- like animal, we would probably never begin to doubt our observation of 
three-leggedness. ft is only When the set of viable identif ice tions 
vanishes that we begin tg circle back, looking for input features that can 
profitably and plnusihly be doubted. And Since things can so easily he 
moved, habitat Is one of the easiest features to doubt. An alligator In my 
Office. Is still an alligator, as long as It is a good alligator in all 
other respects. 

■ 

£n let us assum; :|ut I am walking into my office and there, on th« 
fetid Tloor before ne. is a malevolent green shape, at least eight feet 
long, with row upon row or saber-like teeth. I begin to intersect these 
features with the alreadv-selected set of inhahi tar:j, <jf my uff ic<j--chalrs, 
tahles, plants, Other people, computer terminal, paper, electronic Junk, 
etc, --and find that the intersection is empty. Since I have quite a good 
view of the thing, and since surprises around; HIT are not uncommon, I 
decide to throw nut the expectation marker and to reintersect using only 
the sensory data, {This re-starting of the recognition process may be the; 
source of what we call t> tiOifble-take , J This tine r a clear candidate 
emerges: an alligator or one of his close relatives., i reach for my Bowl* 
knife . . , 

Mote that habitat Cfln be Used Just like any other property to group 
entities together into classes, Thus, we have FAR1-AUIHALS, OFFICE- 
FURhl rriJE,E. p and fHWS&M'CE-PAlWTERS. fcotc, too, tnat a context can be 
created- specifically to cover the hahitats of some particular thing or 
group Of things, Thus, we have grasslands, tsetse-fly country, and the AflB 
of Sail. The process Of treating such a context to contain a commonly- 
associated set of entities is closely analogous to the creation of an 
entity to represent a canmanly- associated set of features. 

This habitat systen uses the same context hierarchy that we 
developed, earlier for absolute contexts. To nark all of the inhabitant* of" 
some con test- -AFRICA, for instance—we would first mark all Of that node's 
super- :.'.iHexts and suh-con texts (in separate sweeps), then would mark the 
inhabitants of all of these contests. Thus, in an AFRICA context, the 
recognition process would be dealing with Inhabitants or AFRICA itself, of" 
Its various parts (ETHIGPU, KENYA. THE-5AHARA, etc. J, and of more 
Inclusive contexts such as OLD-WORLD. *Jote tnat this process would Include 
entities thut inhabit the OLD-WORLD generally, but not those that inhabit 
non-African part* of the QLD-"iJBM.D--tD reach these contexts a marker would 
have to travel to 'the left and then to the right, which is not possible if 
the sweep is done properly. The recognition process would be primed to s.ee 
lions, ostriches, and dromedary camels, but not tigers, rheas, or Bactrian 



camels- A general context such as AFRICA doesn't Haft the set of possible 
entitles vary 'Strongly, but It Kill help to elininate many of the potential 
confusions and ambiguities. 

By choosing a context at an appropriate level of generality. He can 
fncus the system's attention as finely or as diffusely as we desire. IT 
tbe content is BOARD -fiMES^ the system will easily interpret any reference 
to such items 45 Boardwalk, Fnrfc Place, pawn, or rook, but tbe term "hlno" 
is amulgunns:: it could mean either a chess King or a checkers king. If we 
move into the more Specific CIJE55 context j this ambiguity disappears, but 
no« any reference to Boardwalk is a aon - ,5 eju i t \t r which can only be 
understood by pOpplhg uir to a more aesieral context or by abandoning the 
expectation mechanism altogether. It is .not always clear which of the 
superior contents one should move to in such a case: tbe reference could 
be to an actual physical boardwalk, after all. 

. So by Bovjng from node to node in the context hierarchy, the systea 
can activate whatever set of expectations is ftppropriaU' Hjj* a given 
situation, including what is needed, but excluding everything else to 
minimize the potential for ambiguity. This seeos rulch smoother than the 
cider view of switching between a few discrete mini-worlds that have little- 
or nothing in common, 

We are still faced with the problem of choosing which context to 
activate at a given time. Often, of course, the context is supplied. In 
natural language, for Instance, we have such context -specifying phrases as. 
"in natural language". At the start of a no vie, the screen may light Up 
with the words "Paris, 17&9" or nftatever. In real life we generally have a 
pretty yood idea of where we are in space and time H unless we have been 
unconscious or lost. In a conversation, we nay have what anounts to a 
push-flown stack of the contexts we. have passed through. If we are speaking 
of games, and then move either to the more specific CHESS context or to 
some completely unrelated interruption, we will probably keep a record of 
the earlier contest^ any local noit- J e(f« t tur may be an attempt to pop back 
into the GAflLS context, 

luit there returns a Urge sit of cases in which the context Is not 
supplied, but mist be recognized: we join a conversation in the middle; 
the -movie begins with pictures rather than titles; we walk Into a strange 
room not knowing what sort Of room to expect; we are shown a photograph 
with no caption; and so on. The "features" used In this context- 
recognition are the things we find in the context, Though I haven't yet 
worked out the details, the general idea is to find the most specific 
context node that contains all of the items H#P tinned. This can he done by 
narking to the left from the habitat of each item and then looking for the 
rightmost point at which all of these trees intersect. 

Thus, a nehtion of base, diamond, pitcher, bat, and hall clearly 
invoXes the BA5IBALL context, thgugm each of these words tfiken In isolation 
has other possible Oftflnlngs, Base and acid invokes chemistry. Base and 



collector invokes electronics. Pitcher, CUP , and fork invokes table 
jottings. Hot'*., olstinn, and check invokes chess. Cheek, bill, and 
collector invokes fine nee. B-i 1.1 and wing invokes birds. Vina and base 
invokes the Air Force- S-o it goes. The pieces of information hung- in a 
context also have a role to play in contact recognition: If Eisenhower is 
President, this must fci tne 15SU ' s, I think that this process of 
intersect Log In h at* 1 ta n ts to select, a context captures the essence of" what 
Quillian was trying Co get at, with perhflps slightly nore precision; the 
use of ramlora associations hetween certain items to create expectations 
that will be useful In resolving amhiguities. 

There is an interesting circularity at wort here; We are using the 
context to help us recognise the things in it, *hile using the things to 
select the context. Which comes first? The answer, 1 think, is that both 
emerge together, like the solutions to a set of simultaneous, equations or 
the junction-Ubels in the wort of David Waltz [I*]- Consider the process 
of recognizing a photograph of unknown objects in til unknown setting, whore: 
the objects cannnt be seen too clearly, U'e begin by attacking the clearest 
Objects, trying to see what they are- Let's say that a cow emerges. This 
suggests that we are in sone sort of farn context- This, in turn, helps us 
to recognize other objects In the picture: a pig, chickens, a tractor, two 
silos with loading machinery. The tractor and nachinery help US to further 
refine the context: it is a made™ farm with mlKC-d livestock. Once again, 
this, helps. US to recognize objects: the tmng an the ground near the cow 
Is an electric milking MChlnt- And so on. 

The objects and the context, then, refine each Other. The 
circularity is a converging one, once wa get the first bit of the picture 
by brute force. I call this Iiru-firrjer rc-ccjjrri tioif . One finger (or set of 
fingers) starts at the most general object node of the systum; the other 
sUrti <\i the leftnost context, Gradually, by alternating steps, the 
object fingers are moved down and the context finger te the right until we 
"have a rather specific context inhabited' by Specific objects. Clearly, the 

si"--: I'm r, i :i;i- ■ r >-!r- o of n. f-nce u:-J i's n i u i ?.. *. ■ :ur-nt T^arts is anoLher 

exanple of the same process, perhaps this is what the Ge&talt 
psychologists were driving at. 

One big question remains] Should entities be connected to habitats 
by special hardware HA0[ TAT- links? If net< then what should we use? I'm. 
not sure abmjt this at present, fly instincts rebel at the thought dT 
creating a huge new network of HABf TAT- links. Perhaps w,fl can get away with 
using the identity links hung in a context to provide us with inplfcf t 
habitat links: If EISENHOWER is Pttr.ETfjT.hlT in the 1950' s, then EI&EHHOVER 
inhabits tlto K?!jO's. He also inhabits WorHJ Var II because he was a 
GENERAL there, and VEST-POINT Of a certain era as a STUDENT, inhabitants 
with no other role to play in a context can be simply IM-IAGITAMTS. It is 
Clear that this approach would save a lot of links, but I don't yet know 
c.iv^ r.ir vj;,- r:.L:i |i.:-.i it. hr.r r.?.* . we h=id better pl*y it -'. h 1 1> and think In 
terms of explicit HAPfTAT links. 



19, Relations and Frames 

We have j^ett some ways of connecting properties to objects, and of 
hanging facts and entities Id the appropriate contexts, but how do wa 
handle the representation of relations like GREATER -THAW, in which neither 
of tfts objects being related is ^ property or fl part of the flther? Ant* how 
do we nan rile complex frfltne-lifce descriptions which inpose not only a set of 
requirements and properties upon the role-players, but iliO relations 
h-'th-nnr thnm? Hqw do w# >iandle multiple descriptions? What does all of 
this have- to do with contexts, and whiU cl»ar»ges does it suggest in the form 
Of the basic OF-llnk? These are questions that I have only begun to 
explore, and this section will only contain half-baked ideas—not clear 
answers. 

Lot US bug in with the GREATER-THAN relation. What da we want to 
say ahnut it? It is a binary transitive relation *ith t«o "slots" to fill. 
Both slots must be fiDed by entities from the class HEASURASLE-qiJALtTlES; 
each slot mist be filled exactly once in any particular instanco of a 
GREATER -TElAJJ relation, The first rale has the name GREATER; the second, 
the nana SMALLER. Beyond that there is not too ttich to say. This relation 
seems to be a primitive that must be dR-fined hy consistent use, instead of 
by other mare primitive relations. 

- 

A possible network for GREATER -THAW is shown in figure UJ, The 
Structure above the dotted line is the static GREATER -TMflJ description; the 
structure below the line is a particular instantiation, or this. As before, 
the double chevrons flag immediate connection [properties related to the 
role itself), and squiggly arrows are IW~links. Since GREATER and SttALLER 
are singular roles, the CPU program mist insure that each is filled only 
once (a form -Of digestion when new links are added). Since these roles are 
required, the program is free to assume that the role is filled hy 
something appropriate, i^tti if the player is not explicitly stated' in the 
network, (Every person has a liver, etc.) The creation of the A>R node is 
necessary because many pairs of Items will he hung untie r GREATER- THAW, and 
it is essential to renember which GREATER is paired to a given SMALLER, 
Besides, ne night want to say something ahfiut the particular relation 
Itself --that it is an asstinption, perhaps. 

Are the squiggly IH-links shown here the same type that we used to 
represent "Eisenhower was President iff the IffSC'sF I think S0 h but I'm not 

sure. The English COmCs out the same, but that is a dangerous path to 
follow. The use 5 are at least analogous: When we are in the context of 
the A>B relation, the Unit from A to GREATER is in so« sense activated. 
But 1 have not .played with this enough to be sure that I am not missing 
some essential distinction. For now, let's call them the same. 

Though it is conceivable that we would want to reach Into the 
static part of such a network to create spa-clflc exceptions, normally we 
will use it as a black bo*; we will only want to get at the terminal nodes 
representing the relation itself and the sluts. In this case, we need to 
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pake attachments to the QR EATER- THAN , GREATER, and . SHALLE*; nodes. This 
suggests that we can save a lot of clutter hy rirawjng the whole GREATER- 
THAY network as a box, as shown in Finvre L9n. To avoid entflng Jements., wo 
iiy have several GREATER-THAW fooxe s in a given diagram, but they all 
represent the so^r piece of network, not copies. Not* l.hdt lilK'ARV- 
T&MI SI HUE -RELATION cauld itself be a black box with terminals FIRST-ROLE 
and SECQND-RDLE, Hidden inside the GRDATER-THAN box (and In many nther 
boxes as well). Ff we want to get by with even less clutter, we could 
represent the whole instantiated box as a labeled arc, as In figure 19b. 
but this perhaps sweeps too much under the rug. 

Now wo can define SMALLER- THAN by merely hooking up two boxes 
(figure ZO). We simply snitch, the roles of FIRST and SECOND and ploti into 
the terminal) of GR EATER -THAN. SMALLER- THAN then becomes a boy. i- its own 
right. ABOVE is defined as a binary relation between physical objects 
(FW3QB5) with a GREATER- THAN relation, not between the players themselves* 
&ut between their VERTECAL-rOSITlOW properties (figure 21), SUPPORT can be 
defined nver two physnhs, one above and td-uthing the other (figure 22). 
Note that the TOUCH box has only a single slot that can accomodate multiple 
player*; It Is thus, autoaatically reflexive. 

■ 

It seems clear that with this sort of representation one can creafco 
rather complex descriptions , using pre -existing description hoxes as 
subroutines. A FAMILY box can be created with mandatory slots for one 
adult male, one adult female, and many Option*! children of both sexes. 
Inside this box are smaller boxes for HUSBAND -WIFE, BROTHER- 51&TERU PAREWT- 
OFFSPRINfi, etc. An ARCH box would have slots for blocks, and sub-hexes for 
the spatial relations that hold between them. A svMPFGOJJY-ORCHEsrRA box 
would have one slot for a conductor, a few Tor horns, and a couple of dozen 
for violins, with much internal object description, hut not many internal 
relations. An ELECTRONIC -NETWORK 'box is a set or CONNEXTEP-TP relations 
over the terminals of elements that nay themselves be smaller electronic 
networks. As we'wlll sec., ftetions and events are represented in a form 
very similar to relations, so we can create Structures like BlftTHDAV-PARTY 
with suitably restricted slots for the people and things involved, a set of 
internal relations, and some implied actions as well, Such structures* 
when snail, are relations of the sort that we sea in Winston-nets; when 
large, they look like pie Nlnski&n frames. 

But there are a tremendous nunhar of questions still to be answered 

about these structures. What are the precise rules of marker propagation 
for answering the various questions we might ask of these frames 7 What, If 
anything, is the difference in behavior between the IN-links used here and 
5UBC0N links? Do we really need both? How do we indicate that the two 
hases of an arch rfa n-ot touch? That the players in a CR EATER -THAW relation 
Tkiy be any measurable quality, but that they must must be expressed in the 
sens units? That distinct male children in a family are brothers, but that 
nobody is his own brother? Once expressed, how ara these restrictions 
enforced? I don't know, but I'm working on it. 
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It is tempting to try to egress, everything In terms or these 
frame -Structures Of 15-A and EN-links, doing away with explicit OF-links 
altogether, ABRAHAPt would be the- father of ISAAC not because oT a specific 
OF- connect ion between them, but because ABRAHM plays the FATHER role in a 
relation In which !5MC also plays a role (the SOW), Soneth-ihg like the 
EnTTTER of II would still he Uuncj off to the right since it is- a jxrrt oT 
Tl, t>Ut It would Dc luii!? on:y by a SLECOK link, not by an OF-ltnk. To find 
the K of V, we would mark some appropriate set of links- 'the fff-ir it i v € rs e of 
Y--as active, and then pick, up every node hung under X by one- of these 
active links r The OF-Universe would run rightward from V and Its. 
superiors, and would also include the other role links in any relation or 
frame in which Y plflys a part. This isn't exactly right yet, and small 
differences matter here, but it -at least indicates the sort of line 1 an 
following at the moment. 

The point Of all this IS not just to reduce the number of link- 
types by one. [ mentioned earlier that the OF- links had certain prohlens^ 
Chief among these is that, in order for the ladder sweep to work properly, 
the OF -link rungs mist extend all the way down to the level of Individual 
nodes.. Ue cannot' say that every American is the COLIN TRYMAN'-QF .ovory other 
Anerican; instead we oust actually create cailKITRT.11 AN- OF links between each 
pair Of individuals. We could, of course, have the digestion processes 
create these links as new Americans are aided, but that is not the point. 
We would like to do without these links altogether. The creation of extra 
links for reciprocal pairs (HUSBAND-CF and UIFE-OF) is a less extreme form 
of the sane problem. The hope is that membership in a common relation can 
take the place of explicit low-level OF-links between the various role- 
players in the relation. 



So far, we have had no occasion to use the links th ens elves --or 
rather their handle nodes--as contexts* but such situations do arise. To 
see this, let's take another look at the nature of descriptions. The view 
I win present here is related tn--though not identical to--the ideas 
expressed in the fleriin system of hoore and Newell (13). 

A description can be viewed as having three elements : an 
assignment Statement, a set of modifications, and a set of sub- 
descriptions. The assignment is Just an [5--A link; CLYDE IS-A ELEPHANT, 
or whatever. Tne modifications consist of whatever exceptions and 
additions we must make in the ELEPHANT description to nake CLYDE fit: 
smaller ears< a broken tusk, green stripes, etc. The sub- descriptions 
consist of a mapping or CLV Disparts into ELEPHANT -parts; HI Is tne HEAD, 
L3 Is the LEFT~HIND-LEG, etc. Note that each oT these mappings can itselT 
be a description,' with Its own set of modifications and sub-descriptions,, 
recursively for as far as we care to go. 

In the previous Sections, these modifications and sub-descriptions 
have been hung to the right of the node being described (in this case^ from 
CLYDE) by OF and IN' links, hut a strong case can be made for considering 
these things as parts Of tfrc description 0/ CLYDE* rather than of CLYDE 



itseir. This is pretty much a natter of taste as long as each entity has 
only one major description, or when multiple descriptions cover entirely 
different features of the thing being described or agree *ftere they 

overlap. It becomes a matter of considerable importance. however, when the 
two views of in object are in conflict. Examples of this are the Necker 
cube; rtillS-ky" i example or the generator in a car, which is either an. 
electrical network or a mcdinnical assembly; and the voltage divider of 
figure 23, which car be mapped into the standard voltage divider in either 
Of two distinct ways. The point here Is that we can use either description 
profitably, but it would create serious conflicts to have both active at 
once. 

It is t of course, a simple matter to create separate contents to 
hold the various incoiliist-eot descriptions, and to activate only one at a- 
tine. But it is very tempting to use the handle node of the asslgnnent 
link as the context node fro* wtlich the description Is hung h as shown io 
figure £4. This Teels right, sane how. but I have had a lot of trouble in 
integrating this idea with the rest Of the System. It is oot yet clear 
whether it is worth the effort. 

And that, alas, IS the present state of the context system. I 
warned you that it wasn't going to kflJig together. It does, however, look 
like SOmeLMorl that will crystallise nicely, given nop. or two more good 
ideas --or perhaps the elimination of on* or two bad one*. 
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1>, Actions and Verba 

Now that we have developed the absolute context mechanism fpr 
reprPSf.nt.ing multiple states of the world-model, and a mechanlsn for 
binding many facts and relations in tt? a large frame-structure, we can at 
last turn our attention to the representation of events, and actions j 
include in this category both specific events-the assassination V Y John F 
Kennedy,, for lnstance-and event-types such as. "murder" or "catino 
CU S U r?r^ T ' the distinc£ i°n is more or less analogous, to that between CLYDE 
and ELEPHANT. Iji general, Twill use the terms "event 1- and "action" 
interchangeably; the distinction is merely that an action-frame has a Slot 
for the ngent, while an event may not, 1 will use the tern "verb" to refer 
to the word that names an evrvnt-type or action-type, though the relation U 
considerably more complex than the simple word-Ob ject pairs, we saw earlier. 

Stated briefly, an event franc Is just a relation-frane or the type 
we saw in the last section, with the addition of a pair of internal context 
nodes representing respectively, the state of the world before the event 
and the State of the xorld after the event. The MURDER frame for 
instance, would have slots for the MURDERER and the VICTIM, both restricted 
to human beings. The MURDERER is the agent in the frame: there is a 
CAUSES relation between him and the node representing the action All oT 
the above restrictions reside in the 1URDER frane itself. In the included 
REFORE-context we have the Statement that the VICTIM Is alive- Ln the 
AF TEA -con text the ViCTIK is dead. To represent the event of TAIN murdering 
ABELh we just create an instance of the flvRDER irame and. plop CAIB and ABEL 
into the appropriate slots; this event then inherits the proper relations 
and properties , 

■ • 

ourr ErX-S^f h * VS 3 fBW ° ther Sl0ti thAt ar * wrth *' Df "<**? TIME, 

PLACE, and EXPANSION. Time and place are probably self-explanatory, but 
note that '.hey are not always filled in, at least with any precise entry. 
Thus, the TINE slot ror "Cain slew Abel" would simply he filled with PAST 
or perhaps BIBLICAL-TINES, though the event (if it really occurred) was 
probahly „r very <.h-:rt duration. In *Reme fell", we would have to indicate 
an interval of several cen tnries -not a specific date, hour, minute and 
second. Places, too, Bay he very specific, very general, or not specified 

3.L 311 f 

The EXPANSION slot is included in recognition of the fact that 
while «e are perfectly free to speak and think of events as instantaneous 
and indivisible, they in fact are maOe up of a ieiTuetice of SUb-eventS 
This sequence, if specified, is the HTOWMON of the event. The Sequence 
Of sub-events is tied together in such a way that the AFTER-contc*t of one 
15 the BEFORE- con text of the next, and taken together they span the 
distance between the ElfJORE and AFTER contexts of the parent ovent Thus 

-L"? S!7 C f?V 1 *" *** 1 ' ard lMv * lt M «™*i or w B can go on to add 

jy stabbing hin< or -by drmlng his sword, placing the tip against Abel 'a 
Chest, and pushing it in.- The expansion steps, or course, can have their 
own expansions, as far clo«n as our knowledge and interest take us- Sooner 



or later, we nill have to treat soma' level a f events as primitive, btft an 
action that is left print Live in one frame nay be expanded in another* 

*fone of this is particularly revolutionary - The frame-structures 
look: tike case-frames or like Scliank's networks [16]; the «se of BEFOKo and 
AFTER contexts is reminiscent of systems like GPS and STRIPS; the hierarchy 
of events and their flKpflitsions looks rather like the structure of BUILP- 
pltUIS or the scenario representations of Bullwinkle []]. But the present 
system does offsr two clear advantages, ngt because of any unique 
structure, kit because it is able to employ the representational machinery 
that we have already developed Tor static representat jnp : first, the. 
system 1s ab)e to Specify and enforce very precis's restrictions on what can 
occupy the various slots ; second, the System can support a complex 
hierarchy of event-types. 

Let's consider the restriction issue first, Host case-Trame 
systems use only the broadest catenaries to specify what can fill a given 
5 lot: animate object, place, physoh, and so en. In this system, on the 
other hand, we can tie a slot into aTry catenary-node In the network -t 
SOneral or Specific — and can enforce the restriction with the clash- 
detector. Thus, any two physobs can Cut Hie , bet only flowers can aloom 1 , 
only liquids can trickle, only herds of large" herbivores can stDwrrfr. or 
course, these restrictions cut both ways: if something is said to be 
trickling , then we are being told that it i3 a liquid. 

Let me pause here to head off an obvious Objection: Such 
restrictions are often deliberately violated,, as when we say that a girl 
blooms into womanhood, or that sunlight trickles into the forest, or that a 
football team stampedes onto tne field. tHes* are metaphorical uses. It 
Is intended that we will notice the clash and consider the link of girl to 
flower (or whatever 3' to be metaphorical, rather than Literal. 5one 
properties- -beauty and delicncy, perhaps — ore inherited over this lint, 
while others— photosynthesis and cellulose cell-wall s --are not. Exactly 
how we decide Whether a given property makes the jurp is an interesting 
question,, and one which I Cannot yet answer. The relations and Other 
things in the frame are also inherited over the metaphorical link, insofar 
as possible. It Is so convenient to pick ii]t a large package of relations 
in this way—even if they are slightly inappropriate- -that soch metaphors 
*re used often. As the lariojuaoe evolves, a metaphorical USu-ge can become a 
recognize^ second meaning of the verb with its own frame, and can sometimes 
even survive after the original- meaning has dropped from use, 

A related issue Is the use of default assignments to fill slots. 
Those are simply eatra restrictions whose links bear a label stating that 
they may be cancelled with impunity, as we saw in Section 13, Thus the 
5HQQT frame has slots that are restricted by default to GUN and BULLET, but 
we are free to cancel these and substitute Ot-ier pairs of objects: BQW and 
APROU. 5LING5HQT and PE&BLE. etc, (This substitution is not entirely fr»a, 
because the SHOO 1" - f ran = contains a non-cancellable internal relation that A 
LAUNCHES E, and the proposed slot -fillers must conform to this relation,) 



Note that all of these comments About slot-restriction car apply to any 
relation- frame, not just to event-frames. 

A far more important aspect of the event-frame system is Its 
ability to stack ev en t - t yne s into an IS-A hierarchy. Thus. RUN and VALt 
ire special cases of TJUVEL-FJVFuQT, which is- a kind of TRAVEL, which is a 
kind of HOVE. All OF the restrictions. properties, relations., and 
implications attached to the more general event-frames are inherited hy the 
lower ones., and each tnT the lover frames adds its own restrictions as wall. 
flOVF. smply mys th^t some physob is in one location BEFORE And another 
location AFTER. TRAVEL inherits this, adding that the MOVER is moving his 
own body. TftAVEL-BV-FMT says h*w this is done (that is. tt adds A 
restriction to the EXPANSION slot), and RUN adds that it is dona at high 
speed. Implications, too, are inherited: If a certain radar is able to 
detect anything that ,«oirea,it certainly can detect anything that runs . 

But the nore specific actions can also have implications oF their 
own- j3 U „, ?l r,f is very tiring; miking is less tiring. Running a^ay from 
the scene oF a crime is nor* suspicious than walking away. Breaking irecrf 
with J^-me one is a friendly act; breaking windows at the American Fmhassy U 
hostile. EeUffn 1 circi/nTCers stives you gas; eotfjqn/ in general does not, Mote 
that not every actlon-Trame has Its own verb. We need to represent the 
generalized act Of eating cucumbers so that we can state the aboue fact, 
but we do not need to coin a new ward Tor this act, We do happen to have n 
word—Cannibalism-- For eating a member of yqnr own Species. Sg it goes. 
The mechanisms responsible for all oT this inheritance AFO the same ones 
that allow tlVDE to inherit NAnriAL properties, 
* 

To understand hoif important such a hierarchy Is, consider the 
problems Schanfc [16] has without It. He notices that such verbs as RUN and 
WALK nnve a great deal in common, and he feels [correctly, 1 think) that It 
Is essential for the representational system to reflect these similarities . 
In the hierarchical .system, we simply represent these two actions as 
instances of a nore general action that embodies the cocimon in formation J 
the actions are thus related, they inherit many'of the same implications, 
but they have their own. identities as well.. Lacking such inheritance 
■achinery, Jehank's systen must resort to rewriting Every instance or 
running or walking as a riOVE (or. as he calls it, a FTRANSh This dries 
indeed nake evident the similarity between RIJW and WALKL, as we]] as the 
fact that the PTRAN5 implications apply, but RUN and WALK tease to eiist at 
distinct conceptual entities; the differences in their meanings nra 
translated into slight differences in the expansion-network that is 
attached to the PTFlAMS-instance when it is created, 

$UCh an approach requires a great deal of oemory to represent the 
fully-tf landed network For each individual action, hut that is the least or 
its problems, Schank himself points out that FJ5S h for instance, implies 
things, that cannot be deduced from the simple fact that two people are 
touching their lips together. Since Che action KI55 dees not appear in the 
internal representation, there are Only two possibilities: to hang all or 



the KtSS-implicatiatiK in the network repre renting each kiss as it is 
created, or to attach these implications to a conplex pattern that can be 
■atoned against various networks to see if they are Kisses. The former has 
the problem nf all antecedent-driven systems: the question of how far to 
go. The latter has the problen that, in traditional systems, pattern- 
matching is a very tedious process for patterns of any complexity. For 
■atching to work, the representation mist he as canonical as possible--a 
given act must have only one possible representation , This need Tor 
canonical forms is, 1 thini, what drives SchanX to sane of his more 
unpopular positions: Che insistence that all actions be- e^pande-d out to 
the finest level of detail, and the requirement that the number of 
"primitive" vijrbs appearing in the. internal representation be fce.pt to an 
absolute minimun--feurtaen or whatevnr the Current nunber is. 

I mentioned earlier that verbs are the words that we use to n-amo 
various act ion -type francs , but that the mapping is more complex than the 
simple word-meanim] pairs that we found id the world of objects. 1 Chink 
that the verb itself is represented by a frame of some complexity, with 
slots for such syntactic satellites of the verb as the subject h the direct 
and Indirect Objects,, and other entities tied to the verb by such words as' 
"al\ "with", and "by". Whatever fills one of these slots in the verb- 
frame must fill the associated slot in the action-frame. The Indirect 
object in the "GIVE" frame thus becomes the RECIPIENT in the GIVE action- 
rrama, and the object of an AT-phrase is plugged into either the TIME or 
the PLACE slot. As the parser fills the slots, the clash-detector Is hard 
at work rooting out absurdities and nil in a on anbigcious cases, all with its 
usual high efficiency. The verb- frame would probably also indicate such 
things as the FAST-TENSE of the verb. Of course, verbs run' In families and 
much of che verb-frame structure can be shared, .■' 

I have not worked out the details of this verb-Maning mapping, nor 
thought at all about the problems of parsing and language generation in 
this contact. All that 3 am trying to do here i$ to create a well-behaved 
semantic representation that can Handle the output nf a language pron/ram 
and Supply that program with a convenient but powerful set of meaning- 
constraints. The rest I leave to the linguists. I do have one weak 
COnjOCtUre H for what it Ray be worth: Perhflps the various standard 
sentence and phrase structures can be represented as sequences, and tan 
play the same sort of parallel f inite-state-accefltur cariE that 1 proposed 
earlier for speech recognition, This does not seem too far removed from 
Augmented Transition Networks [Z4], and the parallelism might help 
considerably. 

Let me also er-phasize that I do not claim- -yet-- to have a way of 
representing tv?. ru 1 h i a cr that can be expressed in English. Drew TIcDBrroott, 
for exanple, has pointed out that the be fore -a nd- after type of system has 
problems in dealing with actions in which the ongoing process is the 
essential part, Also, 1 have not yet faced Up to the intricacies of such 
actions as PARENT Or CDNS [ PF.R., though the insights of Schanfc may be 
valuable heru. And even when the machinery is fully developed, it will 



r«qulr« much construction of stapler act >oh- frames before we can represent 

such ideas *s EHBE^Ltor RATIWALUE. whose descriptions J"^ 

upon a. rather extensive set Df facts about corporate finance or psychology. 

There ar* a few mora loose ands to til while we are in the general 
urea or natural langunge. First, the problem or multiple languages It 
seems clear that k « nant to use Ch« context ipechinisa Here. Thus, the name 
or a certain concept is "money" in EnoUsh, Minero" til Spanish, "aroent" 
S ^u ' bread in Earlv Hippie, 'loot" in Hollywood Gangster, and 
funds m Bureaucratic. A sub-enntext hierarchy mates 11 possible for 
dialects to Share fflOSt of their words-those in the super -con text -but to 
differ In others, [t is important to hang lUCh words directly from the 
concept and not from the English word; had I known this if. hiqh school," I 
might now be fluent in Spanish. Or course, there will need to be a 
representation for each languor?' 5 distinctive sot of syntax patterns as 

Another randon point is the issue Of nodifiers. We have seen ho* 
to Create an ALBCWO-ELEPFIANT nade by cancelling the OKAY color li !( fc and 
adding WHITE. But how do we represent ALBINO itself? I had originally 
hoped to find a static declarative fa runt for such things. In the original 
proposal I suggested the Hie oT a wmitic packet which, whan activated at 
the same time as another packet, would serve to modify that packet's 
meaning. This Idea died along with the original packet system. It IS now 
Clear to me that a concept like ALBINO oust be a procedure that tells how 
to create an ALBIHD-X node, given an X from a suitably restricted class 
Sometines it will }USt be a matter of cancelling one link-^a different link 
for each item to be alblnoed-and adding a different one; ^-onetimes it will 
be more conplex, as Mien we apply BIG to an object. I have not worked out 
a representation for such procedures, but J suspect that they will look 
very much like action frames; the desired changes would appear as the 
difference between the BEfORE and AFTER contexts, 



■■ 



Which brings me to the last point. I mentioned that the tree of 
actions, their serial expansions, and the further expansions of these Steps 
looked suspiciously Like EUILD-plfliu [3J. Could this bo a good way of 
storing procedural (or "how-toM knot-lodge in the machine? Each action 
that is represented in the system would come equipped Kith one or more 
suggested expansions explaining now to acccnplisb that action, alohg with 
perhaps sone information about the comparative advantages of each 
expansion. Planning, than, would consist Of expanding the top-Level action 
all the way out, until a level of truly primitive actions Is reached- 
impulses to curies, perhaps. This expansion would be done in the exact 
context of the given problem-net in son? generalized context with 

SKS ^? Pa ^ mtters "" 10 thflt tnMjbl * teuid ie jotted immediately. The 
ati-uKE state of an action would serve as a statement of the action's 
prerequisite conditions. 

^ Such plans wnufd be easy to crawl around on: if an expansion 
aoasn t pan out, simply pop up a level or two and try a different one.' And 



the systcn would be very good at rinding LJiq Appropriate action to get from 
a current statf* to j noal state: Simply do an intflr^Ction/recogTiitiDn to 
find the set of actions *hosB HEFQR£ and AFTER slates natch the essential 
fflflturfiS Of ttlO problem. ■ ThLi u^e af recognition to find an appropriate 
operator should faff much mare flexing thun tlie current practice nf nHttorn- 
matching against the goal-statement . This, tan, lfiniss Like a good thesis 
for someone to pursue 



20. Con eluding RenarXs 

In this -section I would lih« to address a few of the global 
questions that naturally arise, concerning this systen; Where do wo go from 
here? Uses this really hav* anything to do with human intelligence? And 
what dees it all meanT 

The ftrst question is the easiest . The Obvious next Step is to try 
to resolve the remaining uncertainties about the context system and the 
exact format of the linfcs. These issues are strongly interdependent, and I 
expect thflt they will all be resolved simultaneously— soon, I hope I 
think that T finally understand the problems that must be solved, but T 
have not yat had time to look for a solution. 1 don't really believe that 
the glossed -over parts of the system could be hiding a flaw large enough to 
bring <i™ the whole structure, but if there is one, it must be lurking in 
this last major area or confusion. Everyone, Including myself, will Teel 
awr* confidence in the system once the Context mess is cleaned up. 

Arter that, It will simply be a matter of tightening down all tho 
screws. A series of medium- sired descriptions-electronic circuits, chunks 
of nBdica 1 knowledge, Simple scenarios, or whatever--will be worked out in 
detail, and a lexicon will be developed showing how various kinds nf 
conceptual structures map into pieces Of network. The procedures for data- 
access, digestion, recognition, and network reorganization will have to be 
made into precise recipes, if not into actual programs. 

It seen* unlikely that any of the above-mentioned exanples 1*111 be 
*° !\V * " ,7B P wtlJip -simulation will be absolutely necessary, but I will 
probably bring one up anyway. It seems a simple enough task* and bast 
experience suggests that it i 5 generally easier to program something then 
to be continually explaining why such * prolan would be of no particular 
value. One area chat will require a simulation, ir it is to be studied 
properly, is the sel r -reorganisation systflmi subtle, large-scale ejects 
may be important here. 

Hopefully, the steps described above should Suffice to convert the 
bag Of hand-waving ideas described here into a reasonably Convincing 
thesis. Sf widespread skepticism persists, it may be necessary to develop 
some larger and more difficult exiles-- the animal-description recognizer 
or something on that scale, Such things Will have tc be done eventually, 
in any event. Beyond all Of this li« the possibility of applying this 
knowledge -base as a tool in solving other problems: vision, speech, 
natural language, problem-solving, children's stories, perhaps even adults' 
Stories, EHJl such thlnys are years in the future, at least. 

As for the psychological reality of all this, I don't have top much 
to say, | have not really had a chance to sift through all of the 
reaction-time- Studies on Class-inclusion and related issues, and I do not 
look forward to the task. Perhaps if I hesitate long enough, sons 
interested psychologist win net there first. fa doubt the available data 



will be both prefuse and contradictory, and new ex pc r 1 men ts nil] have to be 
done. Lot die emp has 1 3 e that E present this descriptive system merely a 
possible fciirrf of model t even tf ice are on tlie right track, there will be 

■any Changes needed to fit the model to reality. 

A form of evidence that is less compelling but--to me—more 
interesting, results from considering how wall the model predicts the 
mistaken, ragged adget, and unintentional side-effects of the human 
knowledgebase, I include in this category such things as add pattern* of 
human forgot fulness (.such as forgetting a word but rememhertng its first 
letter Or what It rhymes with); the even odder stimuli that can causo A 
-forgotten" fact to coma back; thfr mistakes thit the disambiguation 
Machinery makes, same of which are perceived as Jokes (What's black an (J 
HDite and red/read all overfh and the associative Mental phenomena that 
give poetic images their evocative power. These things, I feel, can servo 
as the optical il Unions nf the knowledge system. Any system that works 
must perform the essential tasks correctly- that's What it means to wk-- 
but when two systems make the same nistakes, that points strongly to 
analogous internal structures atid procedures. 

While I have been working en this system, I have frnm tine to time 
encountered such human mental Oddities, and have tried to explain these in 
terms of my networks. Tfle results have been generally encouraging, but 
they are far too scattered for me to discuss at present, i hope that Once 
the bugs are driven out of the context system, 1 will be able to study this 
sort of thing nore systematically. It is a lot more fun than dQllty serious 
[number -crunc hiitg J p sy cha 1 o-gy . 

Ify system does have one glaring deficiency in this respect: For 
certain types of intersection tasks, the machine does better than people 
do. The machine, for instance, would have ng trouble in finding an 
American city whose name is also Che name Of an animal (Buffalo] but ttflhy 
people rin. And the machine, in theory, would never forget anything at all 
except deliberately. Probably much of this can be explained away as the 
difference between inaginary perfect hardware and unreliable neurons, but 
the intersection problem appears to he nore complex, than this. I would 
vory much like to develop a theory to explain why people find certain 
intersection tasks to be harder than others, but I am completely at a loss 
right now: 

One argument in favor of the system is that it appears tp be 
eyolvable. By this, I ti Uai i that though the final system is rather complex, 
It can be reached oy a series of easy steps, each of them « slight 
improvement over the previous state. The simplest type of IS-A net is not 
too different fron a logic net that a very Sl&ple aninal might use to 
combine a few simple inputs with a fen bits of internal state to produce a 
given response. A marginally more complex organism night Use such nets to 
store patterns Of stimuli that correspond to prey, enemies, and so on; a 
Simple interaction- finding progrflu «ould the* be needed. From this point 
the course is obvious: stimuli become complex features' and properties: the 



size of the network and th« complexity nf the "CPU programs" grow; and onn 
by Oh* the fril.ls--eKCeptions, contexts, inmedjate connect ions, find so on-- 
are introduced. In Short, the System would not have to appear full -hi own 
out Of nowhore. It night, in fact, be Interesting to look at the bahavlor 
of various 'lower* animals to see whether they appear to ha lacking, say, 
an exception mechanism. 



What dots it mean? It's hard to my at present, since there is 
it 111 soma small chare* that the whole structure will coma crash jeeu down. 

But if it stavs up. And if it can indeed p*rlOm the hinds Of tasks that I 
have Outlined here, then 1 think it, will have demons t rated something v*ry 
fundamental: That many of the problems thjit «1 In AI have been battling 
against in, recent years are in fact artifices of our overall approach--of 
our dependence upon serial Von Neumann- type nachlnes an d the programming 
techniques that are appropriate to them. That "hen attacked with the 
proper tools-->ritb tree Sweeps and parallel intersections --these problems 
fall easily or never arise. Thitt we do not, after all, have tu resort to 
huge aggregations Of programs aivd denons to deal effectively with Simple 
declarative knowledge—assuming, of course, that we have the parallel 
hardware. 1 have no doubt that ne will encoitnter a new s«t vT pr-oblems-- 
perhaps worse ones- farther on. But after such a long struggle at the same 
set oT roadblocks, it is encouraging to find even a short stretch Of open 
road. 



Zl. Roots 



Ideas. Ji*e living thinps, do not appear spontaneously in a vacuum * 
rather, hey aro created by the OOnbinaEion and evolution of pre-existing 
ideas, in this final section, I wpuld like to point out nv system's 
™«"°rs. r win lirt, w «, r t0 previflUi WDrk whlch ha ^ n - J scme 

influence upon ny thinking; to list all related work Mould take volume. I 
have deliberately plated this section last SO that the relation or the 
wider work to the he* can be plainly seen. 



^ ,,x I 11 * fmr ma ^ r streams fff thought which convene hero ore 
Quilli.n s network theory, nlnsky's fnuaes, Weston's learning-nets, and 
what ™ i B Jt be called the PUWNIR-CWNIVER tradition. The conSrlba tions of 

2m J™ Mil \J l -i ' "*"* Clear ln the P™*»n B sections: From 

Quillian [14] cemesthe idea of using 5PnE sort of simplf paral]ol hHrdwaraj 

^hn ^,,7 Pre H° I1 q * and relatlDn *- From Ninsfcy fiz] comes the idea n-f 

the p usr-m description with default values, a„d a clear vision of how such 
descriptions can be useful. From Winston [23] comes the view of 
description* as deters of discrete relations-^s opposed, say to 
pictures- *pnd the concept of the evolution of tftese clusters over tine. 

i By ?!' ^ WNER - MWS| IVER tradition, I mean not only the languages 
themselves [7, 17, iQ], but also the various attempts to represent 
^™ih?n emi Wino B rfld ^ Blocks World [*Bl. my own extensions or tt in 

the BUILD program [3], Chirniak's childrtlt's stnriei [Zj r and HcDemott ■ * ■ 
monkeys [11], just to nan* | f e *. CDWTIYER was created as a. reaction to 
certain shortcomings Of PLANNER, 4E perceived by its Users [Id]. Packets 
were an attempt to remedy certain weaknesses I had found in Conniver 
especially in the area of demon-control. And, as we have seen this 
network theory has arisen as i result of fatal deficiencies in the packet 
scheme. So the PLANNER- CONN IV£R tradition *as the most direct ancestor of 
the current work, but is the ancestor Hbich it least resembles I doubt 
very Mich whether the theory could have evolved without this chain of 
Intermediate failure-driven stejis-, 

Khiio nni«73* finally br * 1, » ,,t f^e-to-Face with the symbol mapping problem 

while considering son* electronic networks that Socman. .^Derrwtt. and 
Allen flrown were trying to represent by more conventional means These 
. ^wu not fit into packets, and they forced me to go err in search 
or better Ideas. Sussman nnd Brown, in the meantime, developed a network 
representation called AE11E5 *hich h fld much in conmoo with ny early nets 
hut without the special hardware. For a while, the two representations ' 

S-lin" "' ' ^ mih iq ^ " lth the * flrly dBVfll0 ^ nt °' the 

need ror^W^ ^T* ""!/ r ™ Dt,M!r forces: ny appreciation of the 
hi! * ffff ff*** I.S-A hierarchies cam* Trom Uinograd [ZB. Zl, ZZ] « n d I 

crl^ h V C K flUflh J " frra H * 11W "' «* nDtion * ^cription and sub- 
ThI ™f . ?T lnril,e ' 1C(J<1 b ? I'O^e and NeweLl's TltfiN system [131. 

The DVL system of Bill Martin and his group at ILI.T. [b] and the medic^ 



diagnosis system of And«a Rubin [15] have provided nunerous thought- 
provoUng examples and details. Almost everyone at the nil Ai-Lab »p ms to 
be working on .seme sort oF fr^--like Jmckledge representation or an 
application us]ng frame-like ideas, and all of these systems are different 
There has. of course, been soa* cross-poI Jlmitlon of ideas among these 
diverse ap,r*aches. Of these, the wk P f Ben Huipers [BJ P Hitch flarcus 

, Candy Bullwinkle [1], and ftlck Grossman [5] probably have the nost lii 
common with ray own research, though tDore are fundamental differences as 
well. Drew HcPcrmoU and Bob Floore have supplied much excellent and usaflll 
critlclSB. 
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